Description

Build and maintain data pipelines and warehousing solutions within an AWS environment.

This role is on-site.

Responsibilities

• Build and manage data pipelines using AWS Glue and Lambda.
• Develop and optimize data storage solutions using S3, Redshift, and RDS.
• Process large-scale datasets using Spark, Hive, and Kafka.
• Orchestrate complex data workflows using Airflow.
• Implement infrastructure as code using Terraform or CloudFormation.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with AWS services including S3, Lambda, Redshift, Glue, and RDS.
• Strong programming skills in Python and SQL.
• Hands-on experience with Spark, Hive, and Kafka.
• Experience with Airflow for workflow orchestration.
• Knowledge of Terraform or CloudFormation for infrastructure as code.
• Familiarity with CI/CD pipelines using Jenkins or GitLab CI.

Preferred Skills

• Solid understanding of data warehousing concepts and big data technologies.

Key Skills

Education

Any Graduate