Description

You will design and manage end-to-end data architecture and delivery within a SaaS environment, ensuring performance, uptime, and release management of the enterprise data platform.

Responsibilities

• Design and maintain optimal data pipeline architecture to assemble large, complex datasets.
• Manage end-to-end delivery by investigating problem areas and working cross-functionally with product managers and stakeholders.
• Drive optimization, testing, and tooling to improve solution quality and operational effectiveness.
• Develop and manage capacity and growth projection forecasts within budgets.
• Train counterparts in data pipelining and preparation techniques to facilitate data consumption.

Required Skills

• 10-14 years of relevant experience in data architecture or engineering.
• Expertise in Azure Cloud platform and Unity Catalog.
• Strong hands-on experience with Databricks, Apache Spark, and PySpark.
• Proficiency in Python programming.
• Solid grasp of database engineering, design principles, and SQL.
• Experience implementing scalable data engineering solutions using Azure.
• Proven ability to handle large, complex datasets from various sources and databases.
• Experience orchestrating workloads on the cloud.
• Bachelor's or master's degree in computer science or equivalent experience.

Preferred Skills

• At least two years of experience building and leading highly complex technical engineering teams.
• Proficiency with APIs, containerization, and orchestration.
• Familiarity with CI/CD methods and Teradata.

Key Skills

Education

Any graduate