Description

You will build and maintain scalable data ingestion and transformation frameworks on AWS to support analytics and AI initiatives.

This role is on-site.

Responsibilities

• Design and develop enterprise-scale data pipelines using AWS Glue, PySpark, and Python.
• Implement and manage data ingestion frameworks using Fivetran.
• Build and optimize data lake solutions on Amazon S3, including source-to-target mapping.
• Implement data quality, validation, and monitoring frameworks using CloudWatch.
• Collaborate with stakeholders to deliver trusted data products and support GenAI use cases.

Required Skills

• 10+ years of experience in data engineering.
• Proficiency in Python, SQL, and PySpark.
• Hands-on experience with AWS Glue and Fivetran.
• Strong understanding of ETL/ELT development and data lake architecture.
• Experience with Git and CI/CD pipelines.
• Familiarity with RAG architectures.
• Knowledge of Snowflake.

Preferred Skills

• Experience with Amazon Bedrock and prompt engineering.
• Knowledge of dbt, Apache Airflow, or Snowflake governance.

Key Skills

Education

Any Graduate