Description

You will design and implement data processing workflows within an AWS environment.

Responsibilities

  • Build and maintain ETL pipelines using AWS Glue and PySpark.
  • Manage data warehousing tasks within Amazon Redshift.
  • Develop and orchestrate workflows using Oozie and Hive.
  • Provision and manage cloud infrastructure through CloudFormation.
  • Optimize data storage and retrieval using DynamoDB and EMR.

Required Skills

  • 5+ years of experience in data engineering.
  • Expert-level proficiency in Python and PySpark.
  • Hands-on experience with AWS Glue ETL.
  • Experience managing Amazon Redshift clusters.
  • Proficiency with Hive and Oozie orchestration.
  • Experience with AWS CloudFormation for infrastructure as code.
  • Working knowledge of Amazon EMR and DynamoDB.
  • Bachelor's degree or equivalent experience.

Key Skills
Education

Any Graduate

Back To Jobs