Description

You will design and implement enterprise data pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Build data ingestion and complex processing pipelines.
• Develop automated data quality check programs.
• Coordinate with data architecture and analytics teams to meet performance standards.
• Manage code deployment, system testing, and UAT activities.
• Resolve technical data issues for stakeholders and coordinate with offshore teams.

Required Skills

• 10+ years of experience in data engineering.
• Expertise in PySpark and Python.
• Hands-on experience with Azure Databricks.
• Proficiency in Kafka.
• Strong SQL skills.
• Experience with Azure Data Factory (ADF).
• Knowledge of CI/CD and Airflow.
• Working knowledge of Cloud Databases.
• Experience working within Agile methodologies.

Preferred Skills

• Experience managing data from both on-prem and cloud source systems.

Key Skills

Education

Any Graduate