Description

You will design and develop scalable data solutions using Azure Databricks.

Responsibilities

• Design, develop, and enhance complex data pipelines using Azure Databricks.
• Write clean, maintainable, and efficient PySpark and Python code for data ingestion, transformation, and analytics.
• Troubleshoot and resolve data pipeline and workflow issues to maintain high availability.
• Collaborate with architects, analysts, and stakeholders to deliver scalable data solutions.
• Document data processes, architectures, and workflows for knowledge sharing.

Required Skills

• 7+ years of experience in designing and developing scalable data solutions.
• Expertise in Azure Databricks.
• Proficiency in ETL Workflow implementation.
• Strong coding skills in PySpark.
• Experience with Python for data engineering tasks.
• Ability to integrate Databricks with various Azure data services.

Key Skills

Education

Any Graduate