Description

You will build and maintain data pipelines and data models within an Azure environment.

This role is on-site.

Responsibilities

• Design and develop ETL processes and data streams using Azure Data Factory (ADF), Python, and PySpark.
• Transform data across Bronze, Silver, and Gold layers.
• Maintain data models, data dictionaries, governance standards, and security policies.
• Implement data quality checks and troubleshoot complex pipeline issues.
• Collaborate with stakeholders to translate data requirements into technical solutions.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Databricks, PySpark, and Spark.
• Strong command of Python and SQL.
• Experience with Azure Data Factory (ADF).
• Understanding of SOLID design principles and data modelling methods.
• Familiarity with Agile methodologies and software quality assurance.
• Knowledge of data architecture fundamentals.

Preferred Skills

• Experience with complex problem-solving and debugging in distributed systems.

Key Skills

Education

Any Gradute