Description

Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures for large-scale data processing.

This role is hybrid.

Responsibilities

• Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala, and SQL.
• Architect large-scale data solutions ensuring performance, reliability, and security across cloud platforms.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Optimize data workflows and improve system efficiency and scalability.
• Implement monitoring, logging, and alerting mechanisms for data platforms and drive CI/CD adoption.

Required Skills

• 8+ years of overall experience in Data Engineering.
• Strong hands-on expertise with Apache Kafka (streaming, producers/consumers, topic management).
• Advanced programming skills in Scala.
• Experience with Apache Spark for both batch and streaming processing.
• Solid understanding of SQL and distributed systems.
• Experience working with GCP, AWS, or Azure.
• Proven track record in building scalable data pipelines.

Preferred Skills

• Experience mentoring junior engineers and driving best practices in coding and design.
• Knowledge of data quality frameworks.

Refer and earn ₹50,000!

Key Skills

Education

BE/BTech/MSc/Ma