Description

You will design and manage end-to-end data solutions within a SaaS environment.

Responsibilities

• Create and maintain optimal data pipeline architecture, assembling large, complex data sets to meet requirements.
• Drive optimization, testing, and tooling to improve the quality of data solutions.
• Manage teams that build and operate high-volume distributed systems.
• Investigate problem areas and work cross-functionally with product managers and stakeholders.
• Develop capacity and growth projection forecasts for the environment within budget constraints.

Required Skills

• 12+ years of relevant experience.
• At least 5 years leading highly complex technical engineering teams.
• Strong hands-on experience with Databricks.
• Expertise on Azure Cloud platform and knowledge of orchestrating workloads on cloud.
• Strong technical experience in large distributed systems, Data Warehousing, and Data Lake at scale.
• Proficiency with PySpark and Python programming.
• Experience in medallion architecture, ingestion, and quality processes.
• Expertise in API design and containerization.
• Experience managing financial/budget and resource management for medium/large-scale projects.

Key Skills

Education

Any Gradute