Description

You will build and maintain data pipelines within a large-scale AWS environment.

Responsibilities

• Develop and optimize data processing workflows using Python and PySpark.
• Manage big data ecosystems to ensure efficient data ingestion and transformation.
• Deploy and monitor serverless architectures and managed services on AWS.
• Configure and maintain IAM policies to secure data access and infrastructure.

Required Skills

• 10+ years of experience in data engineering.
• Advanced proficiency in Python and PySpark.
• Hands-on experience with AWS Glue and AWS Athena.
• Experience building streaming pipelines with AWS Kinesis.
• Deep understanding of AWS EMR and big data ecosystems.
• Experience managing workloads with AWS Lambda.
• Practical knowledge of AWS IAM for security and access control.
• Bachelor's degree or equivalent professional experience.

Key Skills

Education

Any Graduate