Description

Responsibilities:

• Design end-to-end data architecture solutions on cloud platforms such as Snowflake, leveraging services like Azure Data Factory, Databricks for data integration.
• Implement best practices for data ingestion, storage, processing, and consumption in a cloud environment, ensuring scalability, reliability, and performance.
• Optimize data pipelines for efficiency and cost-effectiveness, utilizing cloud-native tools and services.
• Ensure data integrity, security, and privacy in compliance with organizational policies, industry standards and regulations.
• Collaborate with cross-functional teams to ensure solution designs meet business needs as well as in alignment with the set architecture and guiding principles.
• Create and maintain comprehensive documentation of data architecture, solution designs and system configuration.
• Knowledge of Snowpark, Snowflake Notebooks, Snowpark Container Services, Cortex ML, Cortex AI, and AI functions.
• Experience with Snowflake security, RBAC, row access policies, masking policies, network policies, and resource monitors.
• Experience optimizing Snowflake performance, storage, query execution, concurrency, and credit consumption.
• Knowledge of Snowflake data engineering, application integration, governance, and disaster recovery patterns
• Experience with Databricks SQL, notebooks, jobs, model serving, feature engineering, and MLflow.
• Experience with Databricks Mosaic AI, vector search, foundation models, RAG, AI agents, and model evaluation.
• Experience optimizing Spark workloads, cluster configuration, partitioning, caching, and compute costs.
• Work with application developers and system administrators to ensure compatibility between cloud and on-prem components and resolve any integration challenges
• Leverage Infrastructure as code to adhere to security and compliance standards, and manage cloud resources
• Establish and maintain monitoring frameworks and processes to proactively identify and address performance and cost related concerns, and service availability
• Escalate architecture and design deviations to the Senior Architect for prompt review and addressing.
• Provide technical leadership and mentorship to junior team members, promoting a culture of innovation and continuous learning.
• Evaluate new technologies and tools to drive innovation and improve data architecture capabilities.

Knowledge, Skills and Experience:

• Bachelor’s degree in computer science, engineering, or related field
• 7+ years as a Data Architect or similar role, with a focus on cloud-based data solutions.
• 7+ years of expertise in data warehouse architecture, including data modeling, optimization, ETL/ELT, and administration.
• In-depth knowledge of cloud architecture patterns and solution design principles
• Expert in working with large databases, BI applications, data quality, and performance tuning
• Expert in Azure devops setup, CI/CD pipelines configuration and automated scripts
• Hands-on experience with Azure cloud services (Azure Data Lake, Azure SQL Data Warehouse, etc.) and Databricks for data processing and analytics.
• Strong understanding of Snowflake and Azure Infrastructure services, as well as platform limitations and capabilities
• Good knowledge of Snowflake warehouse security and RBAC models
• Good knowledge and experience with Snowflake database administration and monitoring
• Strong background in relational database concepts with a solid knowledge of star schema, Oracle, SQL, PL/SQL, SQL Tuning, OLAP, Big Data technologies (HANA, Snowflake, or any modern database).
• Experience in designing and implementing scalable, reliable, and high-performance data solutions in a cloud environment.
• Experience with hands-on implementation of Microsoft Azure cloud solutions, including but not limited to the following tools is a plus
• Data Factory
• Data Bricks / Spark
• Azure SQL
• Snowflake
• Logic Apps / Flow / Power Automate

Key Skills

Education

Bachelor's degree