Description

You will engineer and maintain scalable data pipelines using Azure Databricks.

This role is on-site.

Responsibilities

• Lead the design, development, and enhancement of complex data pipelines.
• Write clean, maintainable, and efficient PySpark and Python code for data ingestion, transformation, and analytics.
• Troubleshoot and resolve data pipeline and workflow issues to ensure high availability.
• Collaborate with architects and stakeholders to gather requirements and deliver scalable data solutions.
• Document data processes, architectures, and workflows for knowledge sharing.

Required Skills

• 5+ years of experience in data engineering.
• Expertise with Azure Databricks.
• Proficiency in Python and PySpark.
• Experience implementing ETL workflows.
• Familiarity with Agile methodologies.
• Any Graduate education.

Key Skills

Education

Any Gradute