Description

You will design, develop, and optimize scalable data pipelines using Azure Databricks for enterprise-level processing and analytics.

This role is on-site.

Responsibilities

• Lead the design and enhancement of complex data pipelines using Azure Databricks.
• Write clean, maintainable PySpark and Python code for data ingestion, transformation, and analytics.
• Implement and maintain ETL workflows to ensure high performance, data quality, and reliability.
• Troubleshoot pipeline issues to ensure minimal downtime and high availability.
• Mentor junior team members and participate in code reviews and agile ceremonies.

Required Skills

• 7+ years of experience in data engineering.
• Expertise in Azure Databricks.
• Proficiency in PySpark and Python.
• Experience implementing ETL workflows.
• Ability to integrate with various Azure data services.
• Strong understanding of data pipeline scalability and cost-effectiveness.

Preferred Skills

• Experience documenting data processes and architectures.
• Ability to collaborate with cross-functional teams to align with business objectives.

Key Skills

Education

Any Graduate