Description

You will build and maintain data pipelines within an Azure environment.

Responsibilities

• Design, develop, and maintain data pipelines and data streams.
• Move and transform data across Bronze, Silver, and Gold layers using ADF, Python, and PySpark.
• Develop and maintain ETL processes and data quality checks.
• Collaborate with stakeholders to translate data needs into technical solutions.
• Develop and maintain data models, data dictionaries, governance, and security policies.

Required Skills

• 5+ years of professional experience.
• Proficiency in Databricks, PySpark, and Spark.
• Strong command of Python and SQL.
• Experience with Azure Data Factory (ADF).
• Understanding of SOLID design principles and modelling methods.
• Familiarity with Agile methodologies and software quality assurance.
• Demonstrated ability in complex problem-solving and debugging.
• Knowledge of data architecture fundamentals.

Key Skills

Education

Any Gradute