Description

You will lead the design, development, and management of high-performance data integration pipelines and frameworks.

Responsibilities

• Design and build data pipeline frameworks from scratch, covering ingestion, transformation, and efficient storage.
• Lead and manage a team of data engineers through code reviews, technical guidance, and standard enforcement.
• Perform POCs on open-source and licensed tools to provide architectural recommendations.
• Own data quality, curation, reconciliation, monitoring, and controls across multiple platforms.
• Balance production platform stability with feature delivery and technical debt reduction.

Required Skills

• 12+ years of total experience, including at least 5 years in a leadership role.
• Expertise in GCP cloud platform, including GCS, BigQuery, Pub/Sub, Dataproc, and Dataflow.
• Advanced proficiency in Python, PySpark, SQL, and Shell scripting.
• Hands-on experience with Kafka and CI/CD pipeline models.
• Strong background in data modeling, schema design, and database definition.
• Experience with HANA and distributed data platforms/data lakes.
• Proven ability in technical design documentation and performance tuning.
• Experience supporting reporting models, Looker views, and downstream application needs.
• Ability to navigate ambiguity and coordinate with cross-functional stakeholders.

Key Skills

Education

Any Gradute