Description
You will design and manage end-to-end data architectures and high-volume distributed systems in a SaaS environment.
Responsibilities
- Create and maintain optimal data pipeline architecture to assemble large, complex data sets.
- Lead technical vision while balancing business drivers and stakeholder requirements.
- Manage teams building and operating distributed systems using Agile methodologies.
- Develop capacity and growth projection forecasts within established budgets.
- Drive optimization, testing, and tooling to improve solution quality and engineering velocity.
Required Skills
- 10+ years of relevant experience in data architecture or engineering.
- 5+ years of experience building and leading complex technical engineering teams.
- Strong hands-on experience with Databricks.
- Expertise in Azure Cloud platform and orchestrating cloud workloads.
- Advanced proficiency in PySpark and Python programming.
- Extensive experience with Data Warehousing and Data Lake at scale.
- Deep technical knowledge of large distributed systems.
- Project management experience including financial, budget, scheduling, and resource management.
- Ability to work cross-functionally with Product Managers and customers.
Preferred Skills
- Experience managing distributed teams.
- Proficiency with APIs, containerization, and orchestration.