Description

Lead and mentor a team of 5-6 data engineers while designing scalable data pipelines and real-time streaming applications.

This role is on-site.

Responsibilities

• Lead and mentor a team of 5-6 data engineers, fostering technical growth and collaboration.
• Design and implement scalable data pipelines using Apache Airflow, with preference for Airflow 3.
• Build and maintain real-time streaming applications using Apache Kafka and Spark Streaming.
• Integrate and maintain APIs across multiple systems and platforms using REST/SOAP.
• Drive technical decision-making, establish best practices, and ensure code quality through reviews.

Required Skills

• 8+ years of hands-on experience in data engineering or related fields.
• Strong proficiency in Apache Airflow, including DAG development and workflow orchestration.
• Deep understanding of Snowflake architecture and advanced SQL performance tuning.
• Experience with Apache Kafka for streaming and event-driven architectures.
• Proven experience leading technical teams (3+ years preferred).
• API development and integration experience (REST/SOAP).
• Experience with Agile/Scrum methodologies.

Preferred Skills

• Experience with Airflow 3.
• Experience with MySQL.

Key Skills

Education

Bachelor's degree