Description

You will lead data engineering initiatives within the Azure ecosystem.

This role is on-site.

Responsibilities

• Lead data engineering initiatives and participate in business discussions to gather requirements.
• Design and implement data pipelines using Databricks, Spark, and Azure Data Factory.
• Develop complex SQL queries for extraction, transformation, and analysis with performance tuning.
• Automate workflows using CI/CD tools and ensure data governance with Delta Lake.
• Document processes, workflows, and data analysis results effectively.

Required Skills

• 5+ years of experience with modern Azure Data platforms.
• Expertise in Azure Data Factory, Databricks, and Data Lakes.
• Proficiency in PySpark, Spark, and Azure Synapse.
• Advanced SQL skills, including functions, joins, subqueries, and performance tuning.
• Hands-on experience with PySQL/SQL and ELT/ETL patterns.
• Experience with Data Lakehouse architectures and Unity Catalog.
• Proficiency using Git for version control in data projects.

Preferred Skills

• Familiarity with batch and streaming data solutions.
• Understanding of data engineering workflows and best practices in Databricks.

Key Skills

Education

Any Graduate