Description

Lead the implementation and maintenance of Azure Databricks environments, ensuring efficient data processing and accessibility for stakeholders.

This role is on-site.

Responsibilities

• Implement and maintain robust Azure Databricks architectures.
• Process, clean, and transform raw data into usable formats using ETL processes.
• Collaborate with data scientists and stakeholders to ensure data accessibility.
• Optimize systems to improve data processing efficiency and effectiveness.
• Leverage knowledge of machine learning algorithms to support data initiatives.

Required Skills

• 14+ years of professional experience in data engineering or related fields.
• Deep expertise in Azure Databricks and the Azure cloud platform.
• Proficiency in Python or Scala for data processing tasks.
• Strong command of SQL for relational database management.
• Hands-on experience with Apache Spark.
• Practical understanding of ETL processes and data pipelines.
• Familiarity with Hadoop frameworks and distributed processing.
• Bachelor's Degree in Computer Science, IT, Data Science, or a related field.

Key Skills

Education

Bachelor's Degree