Description

You will maintain, update, and expand the Core Data platform pipelines, building APIs to expose data to downstream applications.

Responsibilities

• Build and maintain real-time streaming and batch data pipelines using Spark and Databricks.
• Develop and expose APIs, including GraphQL, for downstream application consumption.
• Ensure high operational efficiency, SLA compliance, and data reliability for Engineering, Data Science, and Analytics stakeholders.
• Collaborate with product managers and architects to define internal standards, best practices, and naming conventions.
• Document pipeline configurations and maintain platform quality across OLTP and OLAP environments.

Required Skills

• 7+ years of data engineering experience developing large-scale data pipelines.
• Proficiency in Python, Java, or Scala.
• Hands-on production experience with distributed processing systems, specifically Apache Spark.
• Experience with data pipeline orchestration tools such as Apache Airflow.
• Experience with Massively Parallel Processing (MPP) or cloud database technologies, including Snowflake, Databricks, or BigQuery.
• Experience developing APIs, specifically with GraphQL.
• Understanding of OLTP vs. OLAP environments.

Preferred Skills

• Graph Database experience.
• Real-time event streaming experience.

Key Skills

Education

Any Gradute