Description

You will develop and optimize large-scale data processing applications using Spark and Scala.

Responsibilities

• Build and maintain data processing pipelines using Spark and Scala.
• Optimize data workloads through performance tuning, memory management, and fault tolerance strategies.
• Design data models and manage query processing within distributed systems and big data infrastructure.
• Implement streaming solutions and manage data warehousing best practices.

Required Skills

• 5+ years of IT experience.
• Strong proficiency in Scala, including OOP concepts like Singletons, Companion Objects, Classes, and Case Classes.
• Deep understanding of Scala collections (Array, String, Tuple, Set, List, Map) and pattern matching.
• Hands-on experience with Spark data processing and performance tuning.
• Working knowledge of Hive and Sqoop.
• Experience with distributed systems, data modelling, and relational query processing.
• Competency in file handling and multi-threading.

Preferred Skills

• Experience with streaming systems like Spark Streaming, Storm, or Akka.

Key Skills

Education

Any Graduate