Description

Build and manage data pipelines for warehouses, lakes, and marts while designing data products in an Agile/Scrum environment.

This role is on-site.

Responsibilities

• Build data pipelines based on business requirements.
• Design and implement data products and features.
• Create automated data pipelines via workflow orchestration.
• Identify and resolve data management and quality issues.
• Collaborate with Product Owners and Business Analysts.

Required Skills

• Proficiency in PySpark, Spark, and Python.
• Strong SQL skills.
• Experience with Hive.
• Hands-on work with AWS S3, DynamoDB, and AWS services.
• Experience using Redis Cache.
• Experience with Airflow, AWS Lambda, and Athena.
• 2+ years of experience.
• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science