Description

You will build and maintain complex data pipelines using Databricks.

Responsibilities

• Build and maintain complex data pipelines using Databricks.
• Integrate systems and manage data flows.
• Write complex SQL for data analysis and aggregations.
• Document all engineering work and processes.
• Collaborate with team members from diverse technical backgrounds.

Required Skills

• 5+ years of applicable engineering experience.
• Strong proficiency in Python and PySpark for pipeline construction.
• Advanced SQL skills for complex analysis.
• Experience with GCP and BigQuery.
• Working knowledge of file formats including JSON and Parquet.
• Strong understanding of system and data integration.
• Bachelor’s degree in Computer Science or a related discipline.

Key Skills

Education

ANY GRADUATE