Description

Key Responsibilities:

• Design the data architecture for the platform and organizational use cases, focusing on scalability, performance, and support for advanced analytics and data science workloads.
• Ensure the platform supports multi-cloud operations, data sharing, and integration with various data sources, including on-premises and cloud environments.
• Ensure the platform integrates with various  data delivery mechanisms including architecting data delivery mechanisms such as streaming, batch, and leveraging API’s for encryption and decryption.
• Collaborate with Cloud Architects and Engineers to implement data governance, financial governance, and compliance features .
• Identify and architect automation approaches to simplify and accelerate CI/CD across multiple environments, onboarding of new users to the platform, creation of development workspaces, data quality enforcement, and integrated testing.
• Optimize the platform for handling diverse workloads, relational operations, and multi-model data processing.
• Develop and implement data ingestion and data processing frameworks, ensuring efficient and scalable data pipelines for common patterns.
• Architect and maintain data Lakehouse storage solutions, emphasizing best practices for data modeling and schema design.
• Provide guidance on best practices for data preparation exploration, and visualization within the platform.
• Lead client facing workshops and influence change and acceptance to modern data platform practices.
• Provide client-facing support, ensuring clear communication and understanding of technical solutions.
• Collaborate with stakeholders to document enterprise rollout strategies, data security blueprints, and architectural standards.

Must have Qualifications:

• 8+ years of Data Architecture experience
• 3+ years of Databricks architecture/implementation
• 5+ years of AWS Data & Analytics experience
• Strong Databricks on AWS and Lakehouse architecture experience
• Strong data modelling and data integration skills
• Terraform/IaC and CI/CD automation
• Databricks Apps and Unity Catalog
• Batch & streaming data architecture
• Data governance, security, and cost governance
• Databricks troubleshooting and performance optimization
• AI/ML architecture knowledge
• Experience leading client-facing workshops and enterprise data platform initiatives

Key Skills

Education

Bachelor's degree