Description

You will design, develop, and maintain scalable data pipelines and ETL processes within an Azure cloud environment.

This role is on-site.

Responsibilities

• Design and maintain scalable ETL processes and data pipelines using Azure Databricks and Data Factory.
• Implement and optimize Spark jobs, data transformations, and workflows.
• Develop data models, data dictionaries, and data quality checks using Python and SQL.
• Integrate data from multiple sources into Azure Databricks and supply data to warehouses.
• Contribute to the design and implementation of data lakehouse solutions.

Required Skills

• 5+ years of experience in data engineering and data integration.
• Proficiency with Azure Databricks, including PySpark and Spark.
• Strong programming skills in Python, SQL, and Scala.
• Experience with ETL processes, data warehousing, and data modeling.
• Hands-on experience with Microsoft Azure cloud services.
• Knowledge of data governance policies and security procedures.
• Strong problem-solving and debugging capabilities.
• Any Graduate degree.

Preferred Skills

• Experience with Azure Data Factory and other Azure analytics services.
• Familiarity with DevOps, CI/CD, Docker, and Kubernetes.
• Exposure to Hadoop, Kafka, or machine learning pipelines.

Key Skills

Education

Any Gradute