Description

You will build and optimize data pipelines.

Responsibilities

• Design, develop, and optimize data pipelines using Databricks, PySpark, and Delta Lake.
• Build new data pipelines from scratch and enhance existing production code.
• Apply ETL design principles and data modeling concepts while ensuring data governance standards.
• Troubleshoot data issues, perform root-cause analysis, and optimize pipeline performance.
• Collaborate within a scrum team, owning assigned stories and delivering production-ready code.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong technical expertise in PySpark, SQL, and Delta Lake.
• Experience working in Azure environments, including ADLS, ADF, and Synapse.
• Proficiency with Databricks, Azure Databricks, and PySpark.
• Familiarity with Git and CI/CD practices.
• Knowledge of Data Governance and Unity Catalog.
• Ability to work independently and collaboratively in an agile team.

Key Skills

Education

Any Gradute