Description

You will design and implement ETL frameworks using PySpark and Azure Databricks.

Responsibilities

• Develop and maintain code within Azure Databricks notebooks using PySpark and SQL.
• Orchestrate ADF pipelines to manage notebook execution.
• Design ETL frameworks and architectures based on client requirements.
• Troubleshoot and resolve technical issues within Databricks notebooks and ADF pipelines.
• Manage code versions using Git within the Azure ecosystem.

Required Skills

• 10+ years of experience as a Senior Developer.
• Hands-on experience with Azure Databricks and PySpark.
• Proficiency in writing SQL queries for data analysis.
• Experience building and orchestrating pipelines in Azure Data Factory.
• Strong understanding of Data Engineering concepts.
• Practical knowledge of Git and version control workflows.
• Ability to translate requirements into technical architecture.

Key Skills

Education

Any graduate