Description

Design and implement scalable data processing solutions on the Databricks Unified Analytics Platform.

Responsibilities

• Build and maintain efficient data pipelines for movement and transformation.
• Write and optimize Apache Spark code for complex data processing logic.
• Integrate and transform data from multiple sources while ensuring quality and consistency.
• Collaborate with data scientists and stakeholders to define data requirements.
• Design data strategies using various data management tools.

Required Skills

• 8-10 years of extensive experience with Databricks.
• 12-15+ years of experience building data strategies.
• Proficiency in Scala or Python for data processing logic.
• Strong SQL skills for querying and manipulating data across storage systems.
• Experience writing and optimizing Apache Spark code.
• Deep understanding of the Databricks Unified Analytics Platform and its components.
• Proficiency using Databricks Notebooks for interactive data exploration.

Preferred Skills

• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Bachelor's degree