Description

You will design and own ETL pipeline architecture within AWS cloud environments to support business intelligence and analytics.

This role is on-site.

Responsibilities

• Design and develop ETL pipelines to ingest, transform, and validate data based on business specifications.
• Optimize ETL workloads to reduce processing time and cloud costs.
• Develop automated unit, functional, and performance tests to ensure data quality and system reliability.
• Participate in peer code reviews and provide support for production operations.

Required Skills

• 5+ years of experience in Java or Scala.
• 5+ years of experience in ETL projects.
• 3+ years of experience in big data projects.
• Strong experience with AWS EMR, AWS EKS, and Apache Spark.
• Proficiency with AWS DynamoDB and AWS Lambda.
• Experience processing JSON files and writing complex SQL queries.
• Experience with columnar storage formats (ORC or Parquet) and compression techniques.
• Experience with Unix shell scripting and unit testing (JUnit or ScalaTest).
• Proficiency with Git, Maven, or Gradle.

Preferred Skills

• AWS Step Functions or Cloud BPM.
• Python scripting and hands-on DevOps skills.

Key Skills

Education

Any Graduate