Description

You will build and maintain scalable data pipelines and cloud-based data solutions on Azure.

This role is hybrid.

Responsibilities

• Develop and optimize ETL/ELT processes using Azure Data Factory and Azure Databricks.
• Build scalable data pipelines with PySpark and Apache Airflow.
• Manage data warehousing and storage using Azure Data Lake Storage (ADLS).
• Implement CI/CD practices and version control with Git.
• Solve complex data problems within an Agile environment.

Required Skills

• 5+ years of experience in data engineering.
• Strong hands-on experience with Azure Databricks.
• Proficiency in Apache Airflow for workflow orchestration.
• Expertise in PySpark for large-scale data processing.
• Advanced SQL skills.
• Experience with Azure Data Factory (ADF).
• Knowledge of Azure Cloud services and ADLS.
• Familiarity with Git and CI/CD pipelines.

Preferred Skills

• Experience with ETL/ELT design patterns.
• Ability to work effectively in an Agile team.

Key Skills

Education

Any Graduate