Description
You will build and deploy data applications and insight pipelines within an AWS environment.
Responsibilities
- Build and deploy applications using AWS services including S3, Glue, Redshift, and RDS.
- Develop data processing workflows using AWS EMR, Lambda, and Step Functions (State Machine).
- Implement messaging and integration patterns using SNS, SQS, and AppFlow.
- Manage infrastructure and deployments through CI/CD pipelines using CloudFormation and GitLab.
- Integrate with APIs and RESTful services to facilitate data movement.
Required Skills
- 5+ years of experience in data engineering or data analysis.
- Strong proficiency in Python.
- Advanced SQL skills for data analysis and manipulation.
- Hands-on experience with AWS EMR, Glue, and Redshift.
- Experience managing AWS services such as S3, RDS, Lambda, and CloudWatch.
- Knowledge of AWS messaging services including SNS and SQS.
- Experience with ECS and AppFlow.
- Proven ability to build CI/CD pipelines on AWS using CloudFormation and GitLab.
- Fannie Mae institutional knowledge.
Education