Description
You will build and manage data pipelines and transformation processes within an AWS cloud environment.
Responsibilities
- Build and maintain data pipelines to move data from systems of record.
- Develop microservices and APIs using Python or Java.
- Execute complex data transformations and ETL processes.
- Manage data workflows using containerization and Kubernetes.
Required Skills
- 5+ years of professional experience in data engineering.
- Strong proficiency in Python and SQL.
- Experience with Java and microservices architecture.
- Hands-on ETL experience using Informatica.
- Working knowledge of Data Warehousing concepts.
- Experience with AWS cloud services.
- Familiarity with Tableau for data visualization.
- Experience working with Containers and Kubernetes.
- Bachelor's degree or equivalent experience.
Preferred Skills
- Experience with Spark and Scala.
- Experience with Ab Initio.