Description

You will design and implement scalable data engineering solutions using Azure Databricks and Azure Data Factory, managing the full lifecycle from requirements to deployment.

Responsibilities

• Design and implement complex cloud solutions focusing on integration with Databricks and Azure Data Factory.
• Develop and maintain scalable, efficient data pipelines and architectures leveraging Azure Data Lake.
• Ensure optimal architecture and performance of applications deployed on Azure.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Conduct system troubleshooting and provide technical support for data and analytics solutions.

Required Skills

• 7+ years of experience in data engineering.
• 3+ years of experience designing and implementing data solutions using Azure Cloud.
• Proficiency in Azure Data Factory, Azure Databricks, and Azure cloud services.
• Strong knowledge of Python, SQL, or Scala.
• Experience with ETL/ELT development, data modeling, and orchestration techniques.
• Azure Data Engineering or Databricks Certification.
• Bachelor's degree in Science, Technology, Engineering, or Mathematics.

Preferred Skills

• Experience designing scalable data analytics architecture for machine learning and AI.
• Additional Azure certifications such as Azure ML, Analytics Specialty, or Azure Solutions Architect.

Key Skills

Education

Bachelor's degree in science, Technology, Engineering, or Mathematics.