Description

You will develop and manage big data processing solutions using Scala and Spark within the Linux-based Hadoop ecosystem.

This role is on-site.

Responsibilities

• Develop data processing pipelines leveraging Spark and Scala.
• Manage data interaction using Hive and SQL.
• Work within the Linux-based Hadoop Ecosystem (HDFS, Impala, Hive, HBase).
• Process data, including utilizing real-time platforms like Spark Streaming where required.
• Solve complex technical problems and make necessary architectural decisions.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert proficiency in Apache Spark.
• Hands-on coding proficiency in Scala.
• Strong working knowledge of Hive and SQL.
• Experience with HDFS and HQL.
• Familiarity with Hadoop Ecosystem components.
• Strong analytical and problem-solving capabilities.

Key Skills

Education

Any Graduate