Description

You will design and implement scalable data processing workflows using Azure Databricks and Python. You own the end-to-end lifecycle of ETL/ELT pipelines, ensuring reliable data ingestion, transformation, and delivery.

Responsibilities

• Build and optimize scalable data pipelines and solutions using Azure-based data engineering practices.
• Develop, design, and maintain robust ETL/ELT pipelines to support reliable data ingestion, transformation, and delivery.
• Ensure data quality, governance, and performance optimization across pipelines and datasets.
• Collaborate with cross-functional teams to deliver data-driven solutions that meet business and technical requirements.
• Contribute effectively in agile delivery settings within a hybrid environment in Hyderabad.

Required Skills

• 8-11 years of experience in data engineering or related roles.
• Strong hands-on experience with Azure Databricks and Azure data services.
• Expertise in building and maintaining ETL/ELT pipelines.
• Experience working with large-scale data processing and distributed systems.
• Proficiency in data modeling and data pipeline optimization.
• Working knowledge of Python for data processing and automation.
• Strong understanding of data quality, governance, and performance optimization.
• Experience collaborating with cross-functional teams in agile environments.

Preferred Skills

• Application of modern data engineering best practices and scalable architectures to improve pipeline reliability.

Key Skills

Education

Any Graduate