Description

You will own the development and optimization of data processing pipelines on Databricks.

This role is hybrid.

Responsibilities

• Develop and optimize data processing pipelines using Databricks.
• Write complex data transformations using PySpark and Python.
• Query and manage data sources using SQL.
• Maintain and enhance existing data infrastructure.
• Ensure reliability and performance of data workflows.

Required Skills

• 7+ years of professional engineering experience.
• Proficiency in Databricks platform.
• Strong command of Python.
• Expertise in PySpark for large-scale data processing.
• Advanced SQL skills for querying and management.
• Experience with data pipeline architecture.
• Ability to work in a hybrid environment.

Preferred Skills

• Experience with cloud data warehousing solutions.
• Familiarity with CI/CD for data engineering.

Key Skills

Education

Any Graduate