Description

Lead a team of data engineers to design, build, and maintain scalable data pipelines and real-time streaming applications.

This role is on-site.

Responsibilities

• Lead and mentor a team of 5-6 data engineers, fostering technical growth and collaboration.
• Design and implement scalable data pipelines using Apache Airflow, with a preference for Airflow 3.
• Build and integrate real-time streaming applications using Apache Kafka and Spark Streaming.
• Drive technical decision-making, establish best practices, and ensure code quality through reviews.
• Develop and integrate APIs across multiple systems and platforms.

Required Skills

• 8+ years of hands-on experience in data engineering or related fields.
• Strong proficiency in Apache Airflow, including DAG development and workflow orchestration.
• Deep understanding of Snowflake architecture and advanced SQL for complex queries and performance tuning.
• Experience with Apache Kafka for streaming and event-driven architectures.
• Proven experience in API development and integration (REST/SOAP).
• Experience leading technical teams for 3+ years.
• Familiarity with Agile/Scrum methodologies.

Preferred Skills

• Experience with Airflow 3.

Key Skills

Education

Bachelor's degree