Description

You will be responsible for ensuring data quality across migration and enterprise systems.

Responsibilities

• Execute data migration processes from Teradata to Redshift.
• Develop and run ETL tests using tools like Ab Initio, Informatica, and SSIS.
• Implement and maintain data pipeline automation using CI/CD practices.
• Manage data ingestion and processing within AWS environments (Glue, EMR, Athena).

Required Skills

• 7+ years of experience in data engineering or a related field.
• Advanced proficiency in SQL and Unix/Linux scripting.
• Hands-on experience with AWS services including Redshift, Glue, EMR, Athena, and SageMaker.
• Familiarity with Big Data technologies: Hadoop, Hive, Kafka, MongoDB, and Cassandra.
• Experience with DevOps tooling: Jenkins, GitLab, CI/CD, Docker, EKS, and Kubeflow.
• Proficiency in testing frameworks: API/Rest Assured, Java, Selenium, Cypress, and BDD/Cucumber.
• Strong background with data lakes and data warehouses in large-scale enterprise applications.

Key Skills

Education

Bachelor's degree