Description

You will support a mainframe systems modernization initiative by engineering ETL batch processes using cloud-native tools.

Responsibilities

  • Re-engineer mainframe batch jobs into equivalent ETL batch processes, primarily using AWS Glue.
  • Design, code, and test Glue jobs, ensuring performance meets requirements and adhering to coding standards.
  • Implement solutions using Glue ETL PySpark jobs, SQL queries, Lambda, Step Functions, and REST API calls.
  • Coordinate infrastructure needs with architecture and infrastructure teams to implement the overall solution.
  • Document design specifications and leverage Jira/Confluence to track development activities.

Required Skills

  • 8-12 years of experience with a Bachelor’s degree, or 6-10 years with a Master’s degree, in a role involving ETL development.
  • Strong development experience using Amazon Web Services (AWS) and AWS Glue Studio.
  • Proficiency with PySpark and Python for data transformation.
  • Experience with relational databases, specifically PostgreSQL.
  • Familiarity with the full software development lifecycle (SDLC) and ETL development.
  • Experience utilizing version control systems like CodeCommit, CodeBuild, and CodePipeline.
  • Experience tracking work using issue/problem tracking systems like Jira.
  • Experience working in a fast-paced development environment.

Education

Any Graduate