Description

You will design, build, and optimize scalable data pipelines and distributed systems for enterprise analytics and real-time processing.

This role is on-site.

Responsibilities

• Architect and maintain large-scale data platforms using AWS services including RDS, Lambda, and Glue.
• Develop robust batch and streaming pipelines with Apache Spark and Spark Streaming.
• Implement real-time data ingestion and processing using Kafka.
• Write complex SQL queries and optimize database performance through indexing and query tuning.
• Build backend components and data utilities using Java, Scala, or Python.

Required Skills

• 6+ years of experience in Data Engineering.
• Strong proficiency with AWS ecosystem (RDS, Lambda, Glue).
• Hands-on experience with Apache Spark, Spark Streaming, and Kafka.
• Advanced SQL skills with experience in query optimization.
• Programming experience in Java or Scala.
• Familiarity with Hive, MySQL, PostgreSQL, or Elasticsearch.
• Experience with Python or Shell Scripting.

Preferred Skills

• Experience with enterprise-scale data platforms.
• Deep understanding of batch and streaming architectures.

Key Skills

Education

Any Graduate