Description

You will engineer and manage data pipelines for core data infrastructure.

Responsibilities

• Develop and maintain data processing workflows using PySpark.
• Implement data governance and cataloging using Unity Catalog.
• Build and manage ETL/ELT processes within the Azure ecosystem.
• Write complex queries and stored procedures using SQL.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert proficiency in Python and SQL.
• Hands-on experience with PySpark.
• Demonstrated experience with Unity Catalog.
• Familiarity and working knowledge of Databricks.
• Experience working within the Azure cloud environment.

Key Skills

Education

Any Gradute