Description

You will build and optimize data pipelines within a Big Data environment, owning core integration projects and performance tuning.

This role is hybrid.

Responsibilities

• Develop and maintain data integration projects using Big Data technologies.
• Build Kafka-based data ingestion and retrieval programs.
• Tune Hadoop, Spark, and Hive parameters for performance optimization.
• Ensure high code quality through rigorous automated testing and engineering best practices.
• Migrate workloads to AWS and write reusable code components.

Required Skills

• 7+ years of strong Java programming experience.
• 3+ years of experience with Hadoop MapReduce, Sqoop, Oozie, Hive, and Spark.
• 2+ years of AWS experience, including Lambda, S3, Redshift, and Glue.
• Solid experience with Kafka, specifically for data ingestion and retrieval.
• Strong SQL query writing and data analysis skills.
• Good shell scripting experience.

Preferred Skills

• Experience migrating existing workloads to AWS.

Key Skills

Education

Any Graduate