Description

Build and maintain data architectures and pipelines to support analytics and forecasting.

This role is on-site.

Responsibilities

• Streamline and automate forecasting and capacity planning processes using PySpark.
• Convert existing Alteryx workflows into supported analytics formats.
• Build and maintain ETL processes and data pipelines.
• Define data and reporting operations processes and performance monitoring metrics.
• Implement rapid prototyping and deployment of capabilities to the target state platform.

Required Skills

• 4+ years of experience in big data development.
• Proficiency with PySpark and Spark SQL.
• Strong experience with SQL tuning and data validation.
• Expertise in dimensional and relational data modeling.
• Hands-on experience with Hadoop and SparkML.
• Competency in UNIX and SQL operations.
• Experience working within Agile/SCRUM frameworks.
• Ability to transition processes from Excel or Alteryx to PySpark.

Preferred Skills

• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate