Description

You will design, develop, and maintain large-scale data processing systems within distributed environments.

This role is on-site.

Responsibilities

• Design and develop large-scale data processing systems using Hadoop and Spark.
• Write optimized Spark jobs using Scala to ensure efficient data processing.
• Implement and manage data pipelines and workflows using HDFS, Hive, Kafka, and HBase.
• Optimize data processing tasks to ensure high performance and application responsiveness.
• Collaborate with data engineers, analysts, and product teams to deliver data-driven solutions.

Required Skills

• 5+ years of experience working with Hadoop and Spark for data engineering.
• Strong expertise in developing Spark jobs using Scala.
• Proven ability to optimize performance in distributed environments.
• Experience building and maintaining data pipelines using HDFS, Hive, Kafka, and HBase.
• Proficiency in SQL and Python.
• Knowledge of big data application development and system scalability best practices.
• Any Graduate degree.

Preferred Skills

• Experience collaborating with cross-functional product teams.

Key Skills

Education

Any Graduate