Description

Build and optimize data pipelines and infrastructure using Python, Spark, and AWS services to support data scientists and business analysts.

This role is hybrid.

Responsibilities

• Design and implement data collection, transformation, and reliability systems.
• Manage data pipelines feeding dashboards, reports, and custom visualizations.
• Collaborate with subject matter experts and data scientists to troubleshoot issues and translate datasets into insights.
• Apply Agile methodologies and modern software delivery practices, including source control and continuous delivery.
• Identify and implement enhancements for data processing efficiency, integrity, and quality.

Required Skills

• 5+ years of experience developing in Python.
• Hands-on experience with Apache Spark and large data sets.
• Proficiency with AWS technologies: Glue, S3, and Redshift.
• Experience with modern software delivery practices, including source control and testing.
• Ability to design and optimize data pipelines for reliability and efficiency.
• Bachelor's degree in a relevant field.

Preferred Skills

• Experience with Qlik Replicate.

Key Skills

Education

Bachelor's degree