Description

You will design, develop, and maintain scalable data pipelines for enterprise data solutions. You will own the full lifecycle from discovery and analysis to production monitoring and optimization.

This role is on-site.

Responsibilities

• Build and maintain scalable data pipelines using Scala, SQL, and Apache Spark within Azure Synapse.
• Troubleshoot pipeline failures, data quality issues, and performance bottlenecks in production.
• Lead refactoring, cleanup, and modernization of existing codebases and data warehousing logic.
• Develop reusable frameworks, patterns, and automation capabilities in a metadata-driven architecture.
• Manage source code via GitHub and collaborate with cross-functional teams to deliver high-quality data solutions.

Required Skills

• 10+ years of hands-on Data Engineering experience.
• Deep understanding of Apache Spark architecture and core concepts.
• Strong programming experience with Scala and/or Java.
• Advanced SQL development and query optimization skills.
• Experience building enterprise data solutions within Azure Synapse.
• Strong understanding of data warehousing principles and large-scale data integration.
• Proficiency with GitHub for source control and code management.

Preferred Skills

• Experience with Microsoft Fabric.
• Familiarity with marketing data, consumer analytics, or CPG datasets.

Key Skills

Education

Bachelor's degree