Description

You will build and maintain scalable data pipelines and infrastructure.

Responsibilities

• Design and implement ETL workflows using PySpark and AWS Glue.
• Orchestrate data processing jobs using Apache Airflow.
• Manage and query data lakes using AWS Athena.
• Automate infrastructure provisioning using Terraform.

Required Skills

• 6+ years of professional experience in data engineering.
• Strong proficiency in Python.
• Hands-on experience with AWS Lambda.
• Expertise in PySpark for large-scale data processing.
• Experience with Apache Airflow for workflow scheduling.
• Familiarity with AWS Glue and AWS Athena.
• Basic knowledge of Terraform for IaC.

Key Skills

Education

Any Graduate