Description

You will build and maintain AWS-based data pipelines for ingestion, transformation, and loading into a data lake.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines using AWS services for data ingestion and transformation.
• Model data structures specifically for cloud or data lake environments.
• Write and optimize complex SQL queries for data manipulation and extraction.
• Debug and troubleshoot issues within ETL processes and data workflows.
• Apply Agile methodologies to deliver data solutions.

Required Skills

• 5+ years of experience in data engineering.
• Strong proficiency in Python and SQL.
• Experience with Apache Spark for data processing.
• Hands-on experience with AWS ecosystem (S3, Lambda).
• Proficiency with Infrastructure as Code tools like Terraform.
• Familiarity with CI/CD tools, specifically Jenkins.
• Knowledge of data modeling principles in cloud environments.

Preferred Skills

• Experience with AWS Glue.
• Familiarity with Informatica.

Key Skills

Education

Any Graduate