Description

You will design, build, and optimize scalable data pipelines and infrastructure on AWS.

This role is on-site.

Responsibilities

• Develop and optimize data pipelines using Python and PySpark.
• Build scalable data solutions leveraging AWS services such as S3, Glue, Lambda, ECS, and EKS.
• Implement infrastructure as code using Terraform to manage cloud resources.
• Develop and manage CI/CD pipelines with Git for automated deployment.
• Build, integrate, and maintain RESTful APIs and microservices architectures.

Required Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on proficiency with Python and PySpark.
• Extensive experience with AWS services, specifically S3, Glue, Lambda, ECS, and EKS.
• Practical experience with Terraform for infrastructure as code.
• Experience building and managing CI/CD pipelines using Git.
• Knowledge of REST APIs and microservices design patterns.

Preferred Skills

• Experience with PowerShell, SonarQube, Veracode, and Pytest.

Key Skills

Education

Any Graduate