Description

You will design, build, and maintain data-driven infrastructure and pipelines on the Azure cloud platform.

Responsibilities

• Design and develop scalable data pipelines and infrastructure using Databricks for large-scale processing.
• Build and optimize ETL processes to integrate diverse data sources into the data warehouse.
• Collaborate with Data Architects to evolve warehouse architecture and meet business requirements.
• Identify and resolve performance bottlenecks in data pipelines and SQL queries.
• Document data infrastructure, workflows, and engineering processes.

Required Skills

• Proven experience as a Data Engineer focusing on Azure cloud environments.
• Proficiency in Python for data processing and scripting.
• Hands-on experience with Azure Databricks and Apache Spark.
• Strong SQL skills for data querying, stored procedures, and optimization.
• Experience with Azure Data Factory, Azure SQL Database, and Azure Fabric.
• Solid understanding of data warehousing concepts and dimensional data modeling.
• Degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Certifications in Azure, Databricks, or Snowflake.
• Experience with AWS, Google Cloud Platform, or Snowflake.

Key Skills

Education

Any graduate