Description

Build and maintain data pipelines and high-performance REST APIs on the AWS cloud platform.

Responsibilities

• Build PySpark ETL pipelines using AWS Glue and Kinesis.
• Develop high-performance REST APIs using Python and AWS API Gateway.
• Write complex SQL queries to manage and manipulate data.
• Implement CI/CD workflows using GitHub Actions, Terraform, and Octopus.
• Manage cloud infrastructure and services including Lambda and RDS.

Required Skills

• 8+ years of experience in software or data engineering.
• Deep hands-on expertise with AWS Lambda and API Gateway.
• Proficiency in PySpark and Python.
• Experience with AWS data services including Glue and Kinesis.
• Strong knowledge of AWS RDS and ElastiCache.
• Experience with Terraform for infrastructure as code.
• Proficiency with GitHub and GitHub Actions for CI/CD.
• Experience using Octopus for deployment workflows.
• Ability to write complex SQL queries.

Key Skills

Education

Any Graduate