Description

You will lead data engineering efforts within a local San Francisco-based team.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines using Python, PySpark, or Scala.
• Manage and optimize data structures within a Data Lake or similar platform.
• Execute complex data analysis and prototyping using Jupyter Notebooks.
• Write and optimize advanced SQL queries for data processing.

Required Skills

• 12+ years of experience in data engineering.
• Expertise in Python, PySpark, or Scala.
• Strong proficiency in SQL.
• Hands-on experience with Databricks or similar data lake/data platform technologies.
• Experience working with Jupyter Notebooks.
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate