Description

You will lead the design and implementation of large-scale data processing solutions.

Responsibilities

• Analyze, organize, and process raw data using Bigdata technologies.
• Perform data validation, cleaning, and transformation using Spark and Scala.
• Ingest and manage data in HDFS/Hive and analyze data using Spark to produce business insights.
• Develop and maintain data pipelines for processing structured and unstructured data.

Required Skills

• 6+ years of experience in Data project hands-on development and solution engineering roles.
• Expertise in Spark development and application performance tuning.
• Hands-on experience with Scala programming.
• Experience architecting and designing cloud-scale platforms.
• Proficiency with Bigdata technologies including Hadoop, Spark, Kafka, HDFS, and Hive.
• Proven experience debugging and optimizing data/Spark applications.

Key Skills

Education

Any Graduate