Description

Data Engineer (Pyspark/Scala/Kafka/Big Data) 

Experience: 5 - 12 Years

Location – Hybrid - Bangalore

Required Skills - GCP or any Cloud, Big Query, PySpark,Scala, SQL, Python - Kafka is a Plus

iitjobs is looking for highly skilled Data Engineers with strong expertise in Scala, Kafka, Spark, and any Cloud. The ideal candidate should have hands-on experience building scalable data pipelines, processing large volumes of data, and working directly with clients to deliver high-quality data engineering solutions.

Required Skills:-

• 5 – 12 years of overall experience in Data Engineering.

Strong hands-on experience with:

• Apache Kafka (streaming, producers/consumers, topic management)
• Apache Spark (batch & streaming)
• Scala (advanced programming expertise)
• Experience working on Google Cloud Platform (GCP) or any Cloud
• Solid understanding of data engineering concepts, distributed systems, and big data architectures.
• Experience working with large-scale data processing and pipeline development.
• Strong problem-solving and leadership skills.

Key Responsibilities:-

• Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures.
• Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala and GCP/AWS/Azure
• Architect large-scale data solutions ensuring performance, reliability, and security.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
• Optimize data workflows and improve system efficiency and scalability.
• Implement monitoring, logging, and alerting mechanisms for data platforms.
• Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).

Thanks and Regards,

Janaki

iitjobs, Inc. 

Register for a global opportunity on the world's first & only Global Technology Job Portal: www.iitjobs.com

Download our app on the Apple App Store and Google Play Store!

Refer and earn ₹50,000!

Interested candidates, please share your resumes with janaki@iitjobs.com

Key Skills

Education

Bachelor's or Master's degree in Computer Science, Engineering or a related field.