Description

Key Responsibilities:

• Design, develop and maintain production-grade AWS data pipelines.
• Build ETL/ELT solutions using AWS Glue, Python and PySpark/Spark.
• Develop data ingestion and transformation processes using S3 and Lambda.
• Process and transform large datasets using Python and Spark.
• Troubleshoot production data pipelines and resolve performance and data-quality issues.
• Monitor pipelines and workloads using AWS CloudWatch, logging and monitoring tools.
• Optimize Glue/PySpark jobs for performance, scalability and reliability.
• Work with SQL, RDS, GitHub and Terraform as part of the broader technology environment.
• Participate in the modernization of legacy/on-premises systems into AWS.
• Work directly with technical and business stakeholders to understand requirements.
• Translate business requirements into practical AWS/data-engineering solutions.
• Create technical documentation and support requirements gathering when needed.
• Take ownership of technical solutions and independently make engineering decisions.
• Mentor, coach and provide technical guidance to other engineers.

Key Requirements and Technology Experience: 

• 5–8 years of professional experience in data/software engineering.
• Strong hands-on AWS Data Engineering experience.
• Production experience with:
• AWS Glue
• Python
• PySpark / Apache Spark
• Amazon S3
• AWS Lambda
• Strong experience building and supporting data pipelines.
• Strong SQL skills.
• Experience troubleshooting and optimizing production Spark/Glue workloads.
• Experience with data ingestion, transformation and processing.
• Strong understanding of AWS cloud-based data solutions.
• Excellent communication and problem-solving skills.
• Ability to work independently and explain solutions you have personally designed and developed.
• Ability to work onsite in Tempe, AZ four days per week.
• Banking or financial-services industry experience.
• Transaction banking, payments or commercial banking experience.
• Commercial card experience.
• AWS Associate certification or higher.
• Experience with GitHub, Terraform, CloudWatch and RDS.
• Previous experience as a technical lead, mentor or coach.
• Experience working directly with business stakeholders.
• Experience gathering requirements and translating them into technical solutions

Key Skills

Education

Any Graduate