Description

You will manage data integration, testing, and reporting workflows across cloud and on-premises environments.

Responsibilities

• Design and manage AWS testing environments for data workflows during product development and deployment.
• Develop complex SQL scripts and dashboards to summarize data quality analysis and business requirements.
• Execute functional, regression, system, integration, and end-to-end testing for data movement and transformations.
• Analyze data sources, volumes, and business rules to troubleshoot and resolve data anomalies.
• Collaborate with stakeholders and developers to ensure data quality policies and governed attributes are met.

Required Skills

• 5+ years of experience in data engineering and data migration, specifically Teradata to Redshift.
• Advanced SQL proficiency for Cloud ETL and on-premises environments.
• Extensive experience with AWS services including Athena, EMR, and Redshift.
• Strong Python and Unix/Linux scripting skills.
• Deep understanding of data architecture, data modeling, and data warehousing concepts.
• Hands-on experience with DBMS such as Oracle, Teradata, SQL Server, DB2, Redshift, Postgres, and Sybase.
• Experience testing Cloud/On-Prem ETL tools (e.g., Ab Initio, Informatica, SSIS, DataStage, Alteryx, or Glu).
• Proficiency with Scala and MapReduce to HiveQL.
• Experience with NoSQL and unstructured data.
• Familiarity with data science platforms like SageMaker, Machine Learning Studio, or H2O.

Preferred Skills

• Experience with data integration and reporting for various source systems.

Key Skills

Education

Any Graduate