Description

You will build and manage large-scale data processing pipelines within the Azure ecosystem.

Responsibilities

• Build and maintain ETL/ELT workflows to support data processing requirements.
• Implement data modeling concepts to structure data for analysis and transformation.
• Manage data governance and access control using Unity Catalog.
• Collaborate with technical and non-technical stakeholders to solve complex analytical problems.
• Develop scalable data solutions using PySpark and Python.

Required Skills

• 11+ years of experience in data engineering or a related field.
• Strong hands-on experience with Azure Databricks.
• Proficiency in PySpark and Python for large-scale data processing.
• In-depth knowledge of SQL for data analysis and transformation.
• Experience with Unity Catalog for data governance.
• Familiarity with Azure Data Lake, Azure Data Factory, and Azure Synapse Analytics.
• Solid understanding of data modeling and ETL/ELT workflows.
• Any Graduate degree.

Key Skills

Education

Any Graduate