Description

You will design, build, and optimize data pipelines and systems for data collection, transformation, and visualization to support data scientists and business analysts.

This role is hybrid.

Responsibilities

• Lead the design, construction, and optimization of systems for data collection and data transformation.
• Create and maintain data pipelines used by data scientists and business analysts.
• Assist with the development and maintenance of reporting infrastructure, including pipelines that feed dashboards and custom visualizations.
• Collaborate with internal and external subject matter experts to troubleshoot issues and translate complex datasets into actionable insights.
• Proactively identify and implement enhancements in data processing efficiency, integrity, and quality.

Required Skills

• 5+ years of experience developing in Python.
• Experience with Spark and other data tools for large datasets.
• Familiarity with AWS technologies, specifically Glue, S3, and RedShift.
• Experience with modern software delivery practices, including source control, testing, and continuous delivery.
• Experience delivering products using Agile methodologies.
• Experience in data acquisition, dataset processing, and improving data reliability, quality, and efficiency.

Preferred Skills

• Experience with Qlik Replicate.

Key Skills

Education

Any Gradute