Description

You will scale the data platform for analytics and AI by building robust pipelines and solutions.

Responsibilities

• Design, develop, and deploy inbound and outbound data pipelines.
• Optimize pipelines for performance, scalability, and reliability.
• Ensure data quality by preparing remediation plans and fixing root causes with system owners.
• Document design, support strategies, data lineage, and operational metadata.
• Troubleshoot data engineering issues and mentor junior engineers.

Required Skills

• 6+ years of experience building data lakes and cloud data platforms.
• Expert knowledge of SQL and Python programming.
• Experience with GCP technologies including BigQuery, Composer, GCS, DataStream, and Dataflow.
• Proficiency with Apache Airflow for workflow management, extraction, and ingestion.
• Experience with real-time data ingestion using GCP PubSub, Kafka, or Spark.
• Proven experience with incremental execution and successful launches.
• Ability to tune queries for performance and scalability.

Key Skills

Education

ANY GRADUATE