Description
You will design and build data architectures supporting large-scale ML workloads and analytics systems.
Responsibilities
- Design end-to-end data pipelines in complex, regulated data environments.
- Develop data architectures specifically to support ML workloads and feature engineering.
- Engineer and implement data platform solutions using distributed compute architectures.
- Ensure data governance and security compliance within cloud platforms.
Required Skills
- 7+ years of experience in data architecture or large-scale analytics systems.
- Deep expertise with Databricks, PySpark, Spark, and Delta Lake.
- Strong knowledge of Snowflake, including data modeling and performance scaling.
- Proven ability to design data architectures for ML workloads and feature engineering.
- Strong SQL skills and experience with distributed data processing.
- Familiarity with MLOps architectures or model deployment frameworks.
- Demonstrated understanding of Azure cloud platform, IAM, and enterprise security practices.
- Experience in Data Architecture and Data Platform Engineering.