Description

You will lead data engineering initiatives within the AWS environment.

Responsibilities

• Design and implement ETL pipelines using AWS Glue, PySpark, and EMR.
• Manage Kafka topics and integrate data streams into Redshift and Snowflake.
• Oversee CI/CD implementation for data workflows.
• Migrate data platforms, including TerraData to Redshift using Glue.

Required Skills

• 15+ years of professional experience in data engineering.
• Expertise with AWS services (S3, Glue, Redshift, EMR, Lambda, SNS, SQS).
• Strong proficiency in Python and PySpark for data transformation.
• Hands-on experience with Apache Hudi and Kafka.
• Proven ability to build and manage Glue ETL jobs, Catalog, and Workflows.
• Experience implementing CI/CD processes for data infrastructure.
• Familiarity with data warehousing concepts, including Snowflake.

Key Skills

Education

Any Graduate