Description

Build and manage data pipelines for warehouses, data lakes, and data marts. You will design data products using Agile/Scrum and resolve data quality issues.

Responsibilities

• Build data pipelines based on business requirements.
• Design and implement data products and features.
• Create automated data pipelines via workflow orchestration.
• Identify and resolve data management issues.
• Collaborate with Product Owners and Business Analysts.

Required Skills

• Proficiency in PySpark, Spark, and Python.
• Strong SQL skills.
• Experience with Hive.
• Hands-on work with AWS S3, DynamoDB, and AWS services.
• Experience using Redis Cache.
• Experience with Airflow, AWS Lambda, and Athena.
• 2+ years of experience.
• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science