Description

You will design and implement hands-on data solutions within the AWS ecosystem, focusing on ETL pipelines and cluster management.

Responsibilities

• Develop ETL data pipelines using Spark and Java on AWS EMR.
• Configure and manage EMR clusters to ensure stability and performance.
• Process XML data structures within complex data workflows.
• Implement data processing logic using Spark's RDD and DataFrame APIs.

Required Skills

• 5+ years of hands-on experience in Java and Spark programming.
• Deep experience developing ETL pipelines on AWS EMR.
• Working knowledge of AWS Glue, Athena, and Lambda services.
• Proficiency with Spark's RDD and DataFrame APIs.
• Experience with XML processing.
• Familiarity with functional programming concepts.
• Strong understanding of Apache Spark internals.
• Hands-on experience with AWS EMR cluster configuration.

Preferred Skills

• Experience with Scala.

Key Skills

Education

Any Graduate