Description

You will build and maintain ETL pipelines to ingest, transform, and validate data for business intelligence and analytics teams.

Responsibilities

• Design and develop ETL pipelines for collecting, validating, and transforming data according to business specifications.
• Optimize ETL jobs for execution in AWS cloud environments to reduce processing time and costs.
• Maintain data pipeline architecture and implement automated data quality checks.
• Participate in peer design and code reviews within an Agile/Scrum environment.

Required Skills

• 5+ years of experience in Java or Scala.
• 5+ years of experience in ETL projects.
• 3+ years of experience in big data projects.
• Strong experience with AWS EMR, AWS EKS, and Apache Spark.
• Experience with serverless technologies including AWS DynamoDB and AWS Lambda.
• Proficiency in writing complex SQL queries.
• Experience processing JSON files and working with columnar storage formats like ORC or Parquet.
• Experience with API development (REST APIs) and testing using Rest Assured.
• Proficiency in Git, Maven, or Gradle and unit testing with JUnit or ScalaTest.

Preferred Skills

• AWS Cloud BPM/AWS Step Functions and Python scripting.
• Hands-on DevOps skills and application security testing knowledge.

Key Skills

Education

Any Graduate