Description

Lead and mentor a team of data engineers while designing scalable data pipelines, streaming applications, and API integrations.

This role is on-site.

Responsibilities

• Lead and mentor a team of 5-6 data engineers, fostering technical growth and collaboration.
• Design and implement scalable data pipelines using Apache Airflow, with preference for Airflow 3.
• Integrate and maintain real-time streaming applications using Apache Kafka and Spark Streaming.
• Build and integrate APIs across multiple systems and platforms.
• Drive technical decision-making, establish best practices, and ensure code quality through reviews.

Required Skills

• 7+ years of hands-on experience in data engineering.
• Strong proficiency in Apache Airflow, including DAG development and workflow orchestration.
• Deep understanding of Snowflake architecture.
• Advanced SQL skills for complex queries and performance tuning.
• Experience with Apache Kafka for streaming and event-driven architectures.
• API development and integration experience (REST/SOAP).
• Proven experience leading technical teams (3+ years preferred).
• Experience with Agile/Scrum methodologies.

Key Skills

Education

Bachelor's degree