Description
You will design, develop, and support technical solutions for cloud-based data pipelines.
Responsibilities
- Develop and implement ETL processes utilizing Python and Spark.
- Build and maintain RESTful APIs for data services.
- Operate and manage CI/CD pipelines using Jenkins and Docker.
- Collaborate with product managers to deliver data solutions.
Required Skills
- 5+ years of professional experience.
- Expertise in AWS services, including Glue, Lambda, S3, IAM, and Fargate.
- Proficiency in Python and SQL.
- Experience with container orchestration using Docker.
- Familiarity with data warehousing solutions like Snowflake.
- Knowledge of distributed processing frameworks like Spark.
- Experience with version control and issue tracking using Github and Jira.
- Working knowledge of Java and Spring Boot.