Description

You will build and manage data engineering pipelines within Azure cloud environments.

This role is remote.

Responsibilities

• Develop and maintain data engineering pipelines using Spark technology.
• Design and implement complex SQL queries and data models.
• Integrate Databricks with Azure cloud services.
• Apply DevOps best practices and CI/CD workflows to data deployments.

Required Skills

• 9+ years of overall IT experience.
• 5+ years of hands-on experience with Databricks and Azure.
• Extensive experience with PySpark and Spark.
• Proficiency in Python, Scala, or Java.
• Strong command of complex SQL.
• Solid understanding of Big Data and data modeling.
• Experience with Git and CI/CD processes.
• Experience using Jenkins.

Preferred Skills

• Practical exposure to DevOps best practices.

Key Skills

Education

Any Graduate