Description

Build and maintain scalable data pipelines using Azure Databricks and PySpark.

This role is on-site.

Responsibilities

• Design and implement scalable data pipelines using Azure Databricks (ADB) and PySpark.
• Write efficient and optimized SQL queries to process and analyze large datasets.
• Optimize and troubleshoot data workflows for performance improvements.
• Collaborate with cross-functional teams for data integration, transformation, and validation.
• Translate stakeholder requirements into technical solutions and deliver actionable insights.

Required Skills

• 6+ years of experience as a Data Engineer or similar role.
• Expert proficiency in PySpark.
• Strong command of SQL for large-scale data processing.
• Hands-on experience with Azure Databricks (ADB).
• Proven experience designing and implementing data pipelines.
• Experience with data integration and transformation processes.

Preferred Skills

• Ability to work independently with stakeholders to define data requirements.

Key Skills

Education

Any Graduate