Description

You will lead a team of data engineers and own the architecture of scalable data pipelines and streaming systems.

This role is on-site.

Responsibilities

• Lead and mentor a team of 5-6 data engineers, fostering technical growth and collaboration.
• Design and implement scalable data pipelines using Apache Airflow, with preference for Airflow 3.
• Build and maintain real-time streaming applications using Apache Kafka and Spark Streaming.
• Drive technical decision-making, establish best practices, and ensure code quality through reviews.
• Integrate and maintain APIs across multiple systems and platforms.

Required Skills

• 8+ years of hands-on experience in data engineering or related fields.
• Strong proficiency in Apache Airflow, including DAG development and workflow orchestration.
• Deep understanding of Snowflake architecture and advanced SQL for complex queries and performance tuning.
• Experience with Apache Kafka for streaming and event-driven architectures.
• Proven experience in API development and integration (REST/SOAP).
• 3+ years of experience leading technical teams.
• Strong problem-solving and communication skills with experience in Agile/Scrum methodologies.

Key Skills

Education

Bachelor's degree