Description

Design and implement scalable data processing solutions and strategies using the Databricks Unified Analytics Platform.

Responsibilities

• Design efficient, scalable data processing solutions and data strategies using Databricks.
• Integrate and transform data from various sources while ensuring data quality and consistency.
• Build and implement data pipelines for efficient data movement and transformation.
• Write and optimize Apache Spark code to implement data processing logic.
• Collaborate with data scientists, analysts, and stakeholders to translate business requirements into technical data designs.

Required Skills

• 12+ years of experience in data management and building data strategies.
• 8-10 years of extensive experience working with Databricks.
• Proficiency in writing Apache Spark code using Scala or Python.
• Strong SQL skills for querying and manipulating data across storage systems.
• Deep understanding of the Databricks Unified Analytics Platform and its components.
• Experience with ETL tools and methodologies.
• Hands-on proficiency using Databricks Notebooks for interactive data exploration.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate