Description

Key Skills: Python, AWS, Data Engineer, SQL, GIT, Pyspark, Powershell, RESTful, Application Security Testing, Sonarqube, Pytest, Microservices

Roles and Responsibilities:

• Develop and optimize data processing pipelines using Python and PySpark for batch and event-driven workloads.
• Build AWS-based data workflows using S3, Glue, Lambda, Step Functions, and EventBridge.
• Provision and manage cloud infrastructure with Terraform, including repeatable environments and secure configurations.
• Implement CI/CD pipelines with Git to automate build, test, and deployment for data services.
• Deploy and run workloads on ECS and EKS, ensuring reliability, observability, and performance.

Skills Required:

• 5-10 years of experience with 4+ years of relevant data engineering experience.
• Python and PySpark for data engineering development.
• AWS services including Lambda, S3, Glue, Step Functions, EventBridge, ECS, and EKS.
• Infrastructure as Code using Terraform and automation of environment provisioning.
• CI/CD pipelines with Git and experience with automated testing practices.

Good to Have:

• PowerShell scripting for operational automation.
• Code quality and security tooling such as SonarQube and Veracode.
• Automated testing tools including Pytest and Scalates.
• Experience with RESTful and microservices architectures.

Education : Bachelor's Degree in Computer Science or related field

Key Skills

Education

Any Graduate