Description

You will manage AWS infrastructure and build data and CI/CD pipelines using Python and Terraform.

Responsibilities

• Manage AWS infrastructure and IaC using Terraform.
• Build and maintain data and CI/CD pipelines with Python.
• Process large-scale batch data in the terabyte range.
• Implement DevOps and DataOps workflows within Kubernetes environments.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency with AWS services including S3, EMR, SNS, SQS, and Redshift.
• Hands-on experience with Terraform for infrastructure management.
• Strong Python programming skills.
• Experience with Spark or PySpark.
• Working knowledge of Snowflake.
• Experience with Kubernetes orchestration.
• Familiarity with Java.
• Foundational knowledge of SQL.

Preferred Skills

• Experience managing batch data processing at the terabyte scale.

Key Skills

Education

Any Gradute