Description

Lead the migration of ETL jobs and databases from on-premises environments to AWS, building new solutions and providing production support.

This role is on-site.

Responsibilities

• Migrate and replicate on-premises ETL processes to AWS using Glue, PySpark, and data warehouses like Redshift and Aurora PostgreSQL.
• Design, develop, and implement scalable ETL pipelines and full-stack applications or APIs.
• Automate and orchestrate ETL processes using Step Functions, Airflow, and Lambda to optimize performance.
• Conduct data validation, business analysis, and impact analysis to ensure data quality and compliance.
• Provide production support, monitoring, and troubleshooting for ETL configurations and data integrity.

Required Skills

• 8+ years of experience in ETL development, data warehousing, and AWS cloud services.
• Proficiency in Python, Perl, and Shell scripting on Unix/Linux platforms.
• Experience with DataStage or Informatica for legacy ETL understanding.
• Advanced skills in AWS services: Glue, Step Functions, Airflow, Lambda, S3, EC2, RDS, Aurora PostgreSQL, and Redshift.
• API development experience with REST and SOAP frameworks.
• Strong SQL skills for on-premises databases (e.g., DB2) and AWS databases.
• Version control with Git or Bitbucket and CI/CD process familiarity.

Preferred Skills

• AWS certifications and expertise in AI/ML.
• Familiarity with automotive industry data warehousing concepts.
• Experience with data visualization tools like Tableau and Excel.

Key Skills

Education

Any Graduate