Description

Lead a team of 5-6 data engineers to design, build, and maintain scalable data pipelines and streaming systems.

This role is on-site.

Responsibilities

• Lead and mentor a team of 5-6 data engineers, driving technical growth and collaboration.
• Design and implement scalable data pipelines using Apache Airflow, with preference for Airflow 3.
• Build and maintain real-time streaming applications using Apache Kafka and Spark Streaming.
• Integrate and maintain APIs across multiple systems, including REST and SOAP.
• Establish best practices, drive technical decision-making, and ensure code quality through reviews.

Required Skills

• 7+ years of hands-on experience in data engineering.
• Strong proficiency in Apache Airflow (DAG development, workflow orchestration).
• Deep understanding of Snowflake architecture and advanced SQL (complex queries, performance tuning).
• Experience with Apache Kafka for streaming and event-driven architectures.
• Proficiency in Apache Spark and MySQL.
• Proven experience leading technical teams (3+ years preferred).
• Experience with API development and integration (REST/SOAP).
• Strong problem-solving and communication skills.

Preferred Skills

• Experience with Apache Airflow 3.
• Familiarity with Agile/Scrum methodologies.

Key Skills

Education

Any Graduate