Description

You will engineer cloud-based data processing solutions on AWS, focusing on automation, scalability, and near real-time data handling.

Responsibilities

• Build and maintain data pipelines, validation frameworks, and automated job schedules using Python.
• Design and implement scalable architectures for high-volume data storage and processing.
• Collaborate with product owners and data analysts to deliver technical features within an Agile/Scrum framework.
• Minimize technical debt and defects by ensuring automated, sustainable, and scalable code delivery.

Required Skills

• Expert-level proficiency in Python is a hard requirement.
• 4+ years of application development experience with 3+ years implementing scalable architectures.
• 3+ years of experience with AWS services, including EC2, S3, DynamoDB, Lambda, SQS, and SNS.
• Experience with large-scale software development and near real-time data processing.
• Proficiency in SQL and PL/SQL for database development.
• Hands-on experience with CI/CD tools such as Jenkins and Terraform.
• Ability to collaborate effectively with remote teams and communicate technical concepts clearly.

Preferred Skills

• Experience with Snowflake, Apache Spark, Airflow, Elasticsearch, and Kibana.
• Familiarity with job automation tools like Autosys and shell scripting.

Key Skills

Education

Any Graduate