Description

Design and build scalable data pipelines and ETL processes within the Azure ecosystem.

This role is on-site.

Responsibilities

• Design and develop scalable data pipelines using Azure Data Factory and Azure Databricks.
• Implement data storage solutions with Azure SQL Database, Azure Data Lake, and Azure Cosmos DB.
• Create and maintain data models and schemas for efficient storage and retrieval.
• Optimize and troubleshoot pipelines to ensure performance and reliability.
• Ensure data quality and integrity through validation and cleansing techniques.

Required Skills

• 6+ years of experience in data engineering.
• 3+ years of experience specifically with Azure data services.
• Strong expertise in Azure Data Factory and Azure Databricks.
• Proficiency in SQL and Python.
• Hands-on experience with Azure Data Lake, Azure SQL Database, and Azure Cosmos DB.
• Solid understanding of data modeling, ETL processes, and data integration.
• Experience with data warehousing and big data technologies.

Preferred Skills

• Experience with data security and compliance, including encryption, access controls, and monitoring.

Key Skills

Education

Bachelor's degree in Computer Science