Description

You will lead the design and implementation of scalable data pipelines and complex, cross-functional data projects.

Responsibilities

• Lead the discovery phase for medium to large-scale projects and provide technical leadership to project teams.
• Design, implement, and improve data management processes and overarching data architecture.
• Influence data strategy by creating data models and socializing them with business and IT stakeholders.
• Oversee the expansion of existing architecture and optimize query performance through best practices.
• Develop code for large-scale projects while enhancing designs to prevent defect re-occurrence.

Required Skills

• 5+ years of experience in data engineering.
• Expert-level coding in Python and Java.
• Proficiency with Spring and API design.
• Hands-on experience with Kafka, Spark, and Hive.
• Strong knowledge of SQL and No-SQL databases.
• Experience with data integration tools such as Airflow or Automic.
• Experience with Google Cloud Platform (GCP).
• Knowledge of Trinno, BigQuery, and Apache Pinot.
• Experience with data modeling and data migration protocols.
• Familiarity with the Gen AI Ecosystem and Agentic Frameworks.

Key Skills

Education

Any Gradute