Description

Design and implement complex cloud data solutions using Microsoft Azure, with a focus on Databricks and Azure Data Factory integration.

Responsibilities

• Build scalable data pipelines and architectures using Azure services.
• Manage the full lifecycle of data and analytics solutions from requirements gathering to deployment and maintenance.
• Develop ETL/ELT processes and orchestration techniques to ensure optimal application performance.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Implement cloud security measures to ensure compliance with industry standards and company policies.

Required Skills

• 7+ years of experience as a Data Engineer.
• 3+ years of experience designing and implementing data solutions specifically using Azure Cloud.
• Proficiency in Python, SQL, or Scala.
• Hands-on experience with Databricks and Azure Data Factory.
• Experience developing end-to-end solutions leveraging Azure Data Lake, Databricks, and Data Factory.
• Strong knowledge of data modeling and data integration techniques.
• Azure Data Engineering or Databricks Certification.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience designing scalable data analytics architecture for machine learning and AI.
• Additional Azure certifications such as Azure ML, Analytics Specialty, or Azure Solutions Architect.

Key Skills

Education

Bachelor's degree in Computer Science