Description

You will build and maintain core data infrastructure on AWS using Terraform and Glue.

This role is on-site.

Responsibilities

• Design and deploy AWS infrastructure using Terraform, covering S3, Glue, IAM, Lake Formation, and Athena.
• Develop and maintain AWS Glue ETL jobs using PySpark or Python for data ingestion and transformation.
• Orchestrate Glue jobs and data pipelines using Airflow (MWAA or self-managed).
• Manage the Glue Catalog and ensure alignment with Lake Formation security policies.
• Implement data ingestion frameworks for batch and near real-time pipelines.

Required Skills

• 6+ years of experience as a Data Engineer or Cloud Engineer.
• Strong expertise in AWS Services: S3, Glue, Glue Catalog, Lake Formation, IAM, Athena.
• Hands-on proficiency in Terraform (HCL) for infrastructure automation.
• Solid understanding of PySpark or Python for ETL scripting.
• Strong ability to write and optimize complex SQL queries.
• Experience with Airflow DAGs for orchestration.
• Experience with CI/CD pipelines (GitHub Actions, CodePipeline, or Jenkins).

Preferred Skills

• Familiarity with data lake formats such as Iceberg, Parquet, or Delta.

Key Skills

Education

Any Gradute