Description
You will build, launch, and scale a Data Factory Platform as a Service (DFPaaS) to ensure consistent tooling for interoperable data products.
Responsibilities
- Build and scale DFPaaS across data product producers to drive consistency and interoperability.
- Strengthen entitlement capabilities within the data ecosystem.
- Launch self-serve data subscription and sharing features via the Data Portal.
- Improve data discovery by simplifying catalog organization, content tagging, and search.
Required Skills
- 5+ years of engineering experience.
- AWS Lake Formation and Glue Catalog.
- Amazon EMR, EC2, and Serverless architectures.
- Apache Spark and Amazon Athena.
- Angular for frontend requirements.
- Amazon Neptune DB.
- AWS messaging services including SNS and SQS.
- Amazon S3.
- Amazon EventBridge, API Gateway, and AWS Lambda.
- Infrastructure as Code using Terraform or AWS CloudFormation.
- IAM management.
Education