Description

You will lead data engineering initiatives within the Azure ecosystem.

Responsibilities

• Participate in business discussions and gather data requirements.
• Design and implement data pipelines using Databricks, Spark, and related tools.
• Develop complex SQL queries for data extraction, transformation, and analysis.
• Automate workflows using CI/CD tools and ensure data governance with Delta Lake Spark.
• Document processes, workflows, and data analysis results effectively.

Required Skills

• 5+ years of experience with modern Azure Data platforms.
• Expertise in Azure Data Factory, Data Bricks, and Data Lakes.
• Proficiency in PySpark, Spark, and Azure Synapse.
• Advanced SQL skills, including functions, joins, subqueries, and performance tuning.
• Hands-on experience with PySQL/SQL, ELT/ETL patterns.
• Experience with Data Lakehouse architectures and Unity Catalog.
• Proficiency using Git for version control in data projects.
• Familiarity with batch and streaming data solutions.
• Understanding of data engineering workflows and best practices in Databricks.

Key Skills

Education

Any Graduate