Description

You will develop and support IT data solutions leveraging Azure data engineering technologies, ETL, and Python.

Responsibilities

• Develop and maintain data pipelines using Azure Data Factory and Databricks to process datasets.
• Model tables adhering to data warehouse best practices in collaboration with the project team.
• Develop and orchestrate ETL processes to ensure efficient data delivery.
• Manage deployment and monitoring techniques for data solutions.

Required Skills

• 3 to 6 years of experience in IT and Azure Data engineering technologies.
• Proficiency in Python, PySpark, and SQL.
• Hands-on experience with Azure Data Factory, Azure Data Lake Gen2, and Databricks.
• Experience building data pipelines and implementing ETL processes using Azure Data Services.
• Working knowledge of Azure Synapse and data warehouse concepts/modelling.
• Experience with file formats including JSON and Parquet.
• Familiarity with Azure DevOps for CI/CD pipeline implementation.
• Understanding of database systems, preferably Teradata.
• Experience handling source repository integration and operational tasks.

Key Skills

Education

Any Graduate