Description

You will build and maintain production-grade data pipelines on AWS.

This role is on-site.

Responsibilities

• Develop and optimize ETL processes using Python and PySpark.
• Design and manage AWS Glue jobs, crawlers, triggers, and workflows.
• Model and tune DynamoDB for performance, capacity, and data streams.
• Implement CI/CD pipelines using Git, CloudFormation, and Terraform.
• Integrate AWS services including S3, Lambda, Step Functions, and Kinesis.

Required Skills

• 5+ years of hands-on data engineering experience.
• Expert-level Python for data processing and automation.
• Strong proficiency with AWS Glue components.
• Deep expertise in DynamoDB data modeling and tuning.
• Solid SQL and data warehousing fundamentals.
• Experience with AWS Lambda, Step Functions, CloudWatch, IAM, and KMS.
• Proficiency in Git and CI/CD practices.
• Experience with CloudFormation or Terraform for infrastructure as code.

Preferred Skills

• Experience with API development and testing using Postman.
• Knowledge of Kinesis for real-time data streaming.

Key Skills

Education

Any Graduate