Description

Lead the migration and rewrite of legacy applications and ETL processes to cloud-native architectures in Boston, MA.

Responsibilities

• Rewrite existing applications from scratch using Python.
• Migrate on-prem Informatica ETL jobs to Spark and AWS native tooling.
• Develop and maintain data pipelines using AWS Glue, Lambda, and Kinesis.
• Implement infrastructure as code using CloudFormation.

Required Skills

• 4+ years of experience in data engineering.
• Extensive experience with AWS Glue and AWS native data pipelines.
• Proficiency in PySpark and Spark frameworks.
• Strong Python scripting capabilities.
• Hands-on experience with AWS Lambda.
• Experience with AWS Kinesis.
• Experience using CloudFormation for infrastructure deployment.
• Background in migrating ETL processes from Informatica to cloud environments.

Key Skills

Education

Any gradudate