Description

Design and maintain scalable data pipelines and integration solutions using Databricks.

This role is on-site.

Responsibilities

• Design and maintain scalable data pipelines using Databricks and related technologies.
• Implement efficient data transformation processes using Python and SQL.
• Integrate and manage data across cloud platforms including Snowflake and BigQuery.
• Optimize and troubleshoot data workflows for performance and reliability.
• Collaborate with data scientists and analysts to define and meet data requirements.

Required Skills

• 6+ years of hands-on experience in data engineering.
• Expertise in Databricks and Apache Spark.
• Proficiency in Python for data processing.
• Solid experience with Snowflake and Google BigQuery.
• Advanced SQL skills for querying and managing large datasets.
• Experience building and maintaining data lakes and warehouses on cloud platforms.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate