Description

Lead the technical direction and implementation of data engineering and analytics solutions on the Azure Cloud Platform.

Responsibilities

• Design and implement scalable data processing architectures using Databricks.
• Lead and mentor a team of data engineers and data scientists through technical guidance.
• Oversee the implementation of data processing workflows, analytics, and machine learning models.
• Optimize the performance of big data processing tasks, analytics jobs, and queries.
• Manage technical project aspects including timelines, resource allocation, and stakeholder coordination.

Required Skills

• 12+ years of professional experience in data engineering and analytics.
• 8+ years of hands-on experience specifically with Databricks.
• Expertise in Apache Spark and PySpark.
• Strong programming proficiency in Python or Scala.
• Deep knowledge of Databricks architecture and Azure Cloud Platform.
• Experience with ETL processes, data modeling, and data engineering concepts.
• Ability to configure Databricks clusters and optimize big data processing.
• Proven experience in a technical leadership role.

Key Skills

Education

Not specified