Description

Lead the migration of ETL jobs and databases from on-premises environments to AWS, building new ETL solutions and ensuring data quality.

This role is on-site.

Responsibilities

• Migrate and replicate on-premises ETL processes to AWS using Glue PySpark, targeting Redshift and Aurora PostgreSQL.
• Design, develop, and implement scalable ETL pipelines and full-stack APIs for data extraction, transformation, and loading.
• Automate and orchestrate ETL workflows using AWS Step Functions, Airflow DAGs, and Lambda.
• Conduct data validation, analysis, and impact assessment to ensure compliance, security, and business rule adherence.
• Provide production support, monitoring, and troubleshooting for cloud-based data infrastructure and ETL jobs.

Required Skills

• 10+ years of experience in ETL development, data warehousing, and AWS cloud services.
• Proficiency in Python, Perl, and Korn Shell scripting on Unix/Linux platforms.
• Hands-on experience with Informatica or DataStage for legacy ETL understanding.
• Expertise in AWS Glue, S3, EC2, Redshift, and Aurora PostgreSQL.
• Strong SQL skills with experience in DB2 on AIX and Amazon RDS.
• Experience developing REST and SOAP APIs and full-stack applications.
• Familiarity with Jenkins CI/CD pipelines and version control (Git/Bitbucket).
• Ability to analyze data using Excel, Python, and Tableau.

Preferred Skills

• AWS certifications and expertise in AI/ML.
• Familiarity with the automotive industry and data warehousing concepts.

Key Skills

Education

Any Graduate