Description

You will design and maintain scalable big data pipelines using Scala and Apache Spark.

This role is on-site.

Responsibilities

• Design and develop scalable data processing pipelines using Spark and Scala.
• Optimize Spark jobs for performance and efficiency.
• Integrate structured, semi-structured, and unstructured data from various sources.
• Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
• Ensure data quality and implement monitoring and logging.

Required Skills

• 8+ years of programming experience in Scala.
• Hands-on experience with Apache Spark for batch and streaming.
• Experience with ETL processes and distributed computing.
• Familiarity with data storage solutions like HDFS, Hive, or Parquet.
• Proficiency in SQL and data modeling concepts.
• Any Graduate degree.

Key Skills

Education

Any Graduate