Description

You will design and manage data pipelines and cloud infrastructure within an AWS environment.

Responsibilities

• Build and orchestrate data pipelines using AWS Glue and Step Functions.
• Optimize code to resolve performance issues and improve efficiency.
• Implement infrastructure as code using Terraform.
• Apply security best practices by managing IAM roles and policies.
• Maintain data lake, data warehouse, and data lakehouse architectures.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and PySpark.
• Hands-on experience with AWS Glue, S3, and EMR.
• Expertise in Terraform for infrastructure management.
• Experience with AWS Lambda and Step Functions.
• Working knowledge of DynamoDB, Aurora, and RDS.
• Proficiency with AWS Athena, Redshift, and Event Bridge.
• Experience with SQS, SNS, API Gateway, and DynamoDB.
• Practical understanding of CI/CD pipelines and Docker.

Key Skills

Education

Any Graduate