Description

You will design, build, and maintain scalable data infrastructure and pipelines on the Azure cloud platform.

This role is on-site.

Responsibilities

• Design and develop scalable data pipelines using Azure Databricks for large-scale processing.
• Build and optimize ETL processes to integrate diverse data sources into the data warehouse.
• Collaborate with Data Architects to evolve warehouse architecture and meet business requirements.
• Identify and resolve performance bottlenecks in data pipelines and SQL queries.
• Document data infrastructure, workflows, and engineering processes.

Required Skills

• Proven experience as a Data Engineer focusing on Azure cloud environments.
• Proficiency in Python for data processing and scripting.
• Hands-on experience with Azure Databricks and Apache Spark.
• Strong SQL skills for data querying, stored procedures, and optimization.
• Experience with Azure Data Factory, Azure SQL Database, and Azure Fabric.
• Solid understanding of data warehousing concepts and dimensional data modeling.
• Degree in Computer Science, Engineering, or a related field.

Key Skills

Education

Any graduate