Description

You will develop and maintain large-scale data processing solutions.

Responsibilities

• Develop data integration projects using Big Data technologies.
• Tune Hadoop, Spark, and Hive parameters for optimal performance.
• Build Kafka-based data ingestion and retrieval programs.
• Write high-quality, reusable code components following engineering best practices.
• Perform complex SQL query writing and data analysis.

Required Skills

• 7+ years of programming experience using Java, Python, or Scala.
• 3+ years experience with Data Integration using Hadoop MapReduce, Sqoop, Oozie, Hive, and Spark.
• 2+ years experience on AWS, specifically leveraging Lambda, S3, and Glue services.
• Experience with Kafka-based data ingestion/retrieval.
• Strong SQL query writing and data analysis skills.
• Proficiency in shell scripting.
• Experience writing and maintaining testable, high-quality code.

Key Skills

Education

Any Graduate