You will support a mainframe systems modernization initiative by engineering ETL batch processes using cloud-native tools.
Responsibilities
- Re-engineer mainframe batch jobs into equivalent ETL batch processes, primarily using AWS Glue.
- Design, code, and test Glue jobs, ensuring performance meets requirements and adhering to coding standards.
- Implement solutions using Glue ETL PySpark jobs, SQL queries, Lambda, Step Functions, and REST API calls.
- Coordinate infrastructure needs with architecture and infrastructure teams to implement the overall solution.
- Document design specifications and leverage Jira/Confluence to track development activities.
Required Skills
- 8-12 years of experience with a Bachelor’s degree, or 6-10 years with a Master’s degree, in a role involving ETL development.
- Strong development experience using Amazon Web Services (AWS) and AWS Glue Studio.
- Proficiency with PySpark and Python for data transformation.
- Experience with relational databases, specifically PostgreSQL.
- Familiarity with the full software development lifecycle (SDLC) and ETL development.
- Experience utilizing version control systems like CodeCommit, CodeBuild, and CodePipeline.
- Experience tracking work using issue/problem tracking systems like Jira.
- Experience working in a fast-paced development environment.