Description

You will design, develop, and implement data solutions for ingesting, provisioning, and securing data across S3 lakes, Redshift warehouses, and MySQL marts.

Responsibilities

• Develop data solutions using Scala, Apache Spark, and Hive.
• Implement data ingestion and processing pipelines using AWS Glue, EMR, and Apache Kafka.
• Write and execute MapReduce jobs for data processing.
• Participate in testing through review, analysis, and software certification.

Required Skills

• Hands-on experience with Java and Scala.
• Proficiency with Apache Spark.
• Experience with Apache Kafka and Apache NiFi.
• Proficiency with Amazon Web Services (AWS), including S3, Redshift, Glue, EMR, and Data Pipeline.
• Experience writing MapReduce jobs.
• Knowledge of Hive, Apache Pig, and MySQL.
• Experience with Maven, Stash, and Bamboo.
• 5+ years of experience.

Preferred Skills

• Hands-on experience with Talend.

Key Skills

Education

ANY GRADUATE