Description

You will build and maintain the core data infrastructure on AWS.

Responsibilities

• Design, develop, and deploy AWS infrastructure using Terraform, covering S3, Glue, IAM, Lake Formation, and Athena.
• Develop and maintain AWS Glue ETL jobs using PySpark or Python shell for data ingestion and transformation across data layers.
• Orchestrate Glue jobs and data pipelines using Airflow (MWAA or self-managed).
• Manage the Glue Catalog, metadata, and ensure alignment with Lake Formation security policies.
• Implement data ingestion frameworks for both batch and near real-time pipelines.

Required Skills

• 6+ years of experience as a Data Engineer or Cloud Engineer.
• Strong expertise in AWS Services: S3, Glue, Glue Catalog, Lake Formation, IAM, Athena.
• Hands-on proficiency in Terraform (HCL) for infrastructure automation.
• Solid understanding of PySpark / Python for ETL scripting.
• Strong ability to write and optimize complex SQL queries.
• Experience with Airflow DAGs for orchestration.
• Experience with CI/CD pipelines (GitHub Actions, CodePipeline, or Jenkins).
• Familiarity with data lake formats such as Iceberg, Parquet, or Delta.

Key Skills

Education

Any Gradute