Description

You will build and maintain scalable data ingestion frameworks and integrity capabilities on AWS.

This role is on-site.

Responsibilities

• Design and develop scalable data ingestion pipelines and integrity checks.
• Write complex, efficient SQL queries for data processing and manipulation.
• Process large datasets using Big Data technologies.
• Manage source code using SVN or Bitbucket.

Required Skills

• 5+ years of experience in data engineering.
• Extensive experience with AWS Redshift, EMR, RDS, AWS Glue, and Athena.
• Proficiency in Spark, Hadoop, MapReduce, Hive, and Impala.
• Strong SQL skills for complex data manipulation.
• Programming experience in Python and Shell Scripting.
• Experience with source code management tools like SVN and Bitbucket.

Preferred Skills

• Experience with CI/CD pipelines using Jenkins.
• Knowledge of Informatica Big Data Edition (BDE), Scala coding, and Control-M.
• Experience with Oracle, SQL Server, or Informatica Power Center.

Key Skills

Education

ANY GRADUATE