Description

You will build and maintain data pipelines and governance frameworks using AWS-based solutions.

Responsibilities

• Manage data ingestion and governance processes.
• Develop and optimize data processing workflows using PySpark and Snowpark.
• Build and maintain CI/CD pipelines for data infrastructure.
• Implement and manage AWS-based data solutions and storage.

Required Skills

• 4+ years of experience as a Big Data Engineer.
• Proficiency with AWS services including S3, Glue, Athena, and EMR.
• Experience with Redshift and SnowSQL.
• Hands-on expertise with PySpark and Snowpark.
• Experience with Hadoop ecosystems.
• Working knowledge of CI/CD pipelines.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree