Description

You will design and build modern data pipelines and data streams.

Responsibilities

• Move and transform data across Bronze, Silver, and Gold layers using ADF, Python, and PySpark.
• Develop and maintain ETL processes and associated data quality checks.
• Work with stakeholders to define data needs and deliver technical solutions.
• Develop and maintain data models, data dictionaries, governance, and security policies.
• Provide technical guidance and mentorship to junior data engineers.

Required Skills

• 5+ years of professional experience.
• Expert proficiency in Databricks.
• Strong command of SQL and PySpark.
• Experience with Spark and Python.
• Hands-on experience with Azure Data Factory (ADF).
• Proven ability to design and maintain data pipelines and streams.
• Experience managing data governance and security procedures.
• Ability to collaborate across teams to ensure data consistency.

Key Skills

Education

Any Gradute