Description

You will engineer and maintain scalable data pipelines using Azure Databricks.

Responsibilities

• Lead the design, development, and enhancement of complex data pipelines using Azure Databricks.
• Write clean, maintainable, and efficient PySpark and Python code for data ingestion, transformation, and analytics.
• Troubleshoot and resolve data pipeline and workflow issues to ensure high availability.
• Collaborate with architects and stakeholders to gather requirements and deliver scalable data solutions.
• Document data processes, architectures, and workflows for knowledge sharing.

Required Skills

• 5+ years of experience in data engineering.
• Expertise with Azure Databricks.
• Proficiency in Python and PySpark.
• Experience implementing ETL workflows.
• Familiarity with Agile methodologies.

Key Skills

Education

Any Gradute