Description

You will lead the migration of ETL jobs and databases from on-premises environments to the AWS Cloud.

Responsibilities

• Lead the migration of ETL jobs and databases from on-premises environments to AWS.
• Design, develop, and implement AWS Glue PySpark processes to load data into Redshift and Aurora PostgreSQL.
• Automate and orchestrate ETL processes, applications, and APIs to optimize performance and scalability.
• Conduct data validation and analysis to ensure data quality, integrity, and compliance with business rules.
• Provide production support, including monitoring, troubleshooting, and resolving issues for ETL processes and configurations.

Required Skills

• 10+ years of experience in ETL development, data warehousing, and AWS cloud services.
• Proficiency in Python, Perl, and Shell scripting on Unix/Linux platforms.
• Expertise in SQL with experience in DB2, Amazon RDS, Aurora PostgreSQL, and Redshift.
• Hands-on experience with AWS services including Glue, Step Functions, Lambda, S3, and EC2.
• Experience developing APIs using REST and SOAP frameworks.
• Strong background in data analysis and validation using Python, Excel, or Tableau.
• Proficiency with version control tools such as Git or Bitbucket.
• Experience with ETL tools like DataStage or Informatica.
• Knowledge of Airflow DAGs and Jenkins CI/CD pipelines.

Preferred Skills

• AWS certifications and expertise in AI/ML.
• Automotive industry knowledge.

Key Skills

Education

Any Graduate