Description

You will own the development and maintenance of automated ETL pipelines, data workflows, and data quality dashboards.

Responsibilities

• Build automation frameworks using Python to support data product deployment.
• Design and manage data workflows and ETL testing strategies for both cloud and on-prem environments.
• Validate source-to-destination data movement and transformations within database applications.
• Analyze data sources, volumes, and business rules to ensure data integrity.
• Troubleshoot data anomalies and perform root cause analysis to resolve technical issues.

Required Skills

• 5+ years of experience in data quality or SDET roles.
• Proficiency in Python for building automation frameworks and managing workflows.
• Strong experience with AWS components including S3, Glue, and Redshift.
• Expertise in SQL and Unix scripting.
• Hands-on experience with ETL pipeline development and ETL testing.
• Deep understanding of data architecture, data modeling, and data warehousing concepts.
• Ability to interpret and analyze data from various source systems for integration and reporting.
• Experience working within both Waterfall and Agile methodologies.

Preferred Skills

• Experience using Jenkins and GitLab for CI/CD.
• Experience testing storage tools like S3 and HDFS.
• Familiarity with industry-standard defect or test case management tools.

Key Skills

Education

Any Graduate