Description

You will own the end-to-end delivery of data architecture solutions.

Responsibilities

• Design and maintain optimal data pipeline architecture to assemble complex datasets meeting functional and non-functional requirements.
• Drive optimization, testing, and tooling to improve solution quality within a SaaS environment.
• Manage teams responsible for building and operating high-volume distributed systems.
• Investigate problem areas and work cross-functionally with product managers and stakeholders.
• Develop and manage capacity and growth projection forecasts for the environment within established budgets.

Required Skills

• 8+ years of relevant professional experience.
• At least 5 years leading complex technical engineering teams.
• Strong hands-on experience with Databricks.
• Technical experience in large distributed systems, Data Warehousing, and Data Lakes at scale.
• Proficiency in PySpark and Python programming.
• Expertise on the Azure Cloud platform and orchestrating cloud workloads.
• Experience with medallion architecture, ingestion, and data quality processes.
• Familiarity with Unity Catalog architecture, leveraging its Data Governance and Observability capabilities.
• Bachelor's and/or master’s degree.

Key Skills

Education

Not specified