Description

You will build and maintain data pipelines for the O'Fallon, MO office.

Responsibilities

• Develop ETL processes using Spark and Python.
• Manage data workflows with Alteryx and Nifi.
• Write and optimize SQL queries for data extraction and transformation.
• Deploy and maintain infrastructure on AWS or Azure.
• Ensure data integrity and pipeline reliability.

Required Skills

• 8+ years of experience in data engineering.
• Proficiency in Spark and Python for data processing.
• Hands-on experience with Alteryx and Nifi.
• Strong SQL skills for complex queries.
• Cloud experience with AWS or Azure.
• Onsite presence required in O'Fallon, MO.

Preferred Skills

• Experience with both AWS and Azure environments.
• Advanced optimization of Spark jobs.

Key Skills

Education

Any Graduate