Description
Role Overview
We are looking for a Senior Data Architect to join a high-impact enterprise data engineering team building scalable, cloud-based data platforms that power analytics, reporting, data transformation, and AI initiatives.
In this role, you will work closely with enterprise customers to architect, design, and implement modern data solutions on Databricks and cloud platforms. You will play a key role in defining reference architectures, leading complex data migrations, productionizing customer use cases, and enabling successful adoption of modern data and AI technologies.
Why This Role Matters
As a Senior Data Architect, you will be responsible for solving complex data engineering and architecture challenges for strategic customers. You will work across the full project lifecycle—from architecture and design through implementation and deployment—while helping organizations modernize their data platforms and scale their analytics and AI capabilities.
Key Responsibilities
- Design and implement scalable, performant, and production-ready data architectures using Databricks and cloud technologies.
- Lead and support large-scale data migrations to and from Databricks environments.
- Develop reference architectures, technical documentation, implementation guides, and how-to's for customer use cases.
- Guide strategic customers through the design, implementation, and deployment of modern data and AI solutions.
- Work closely with engagement managers and customers to understand requirements, define technical scope, estimate effort, and plan project delivery.
- Consult with customers on architecture, technology selection, solution design, and best practices.
- Bootstrap and implement customer projects to drive successful evaluation, adoption, and production deployment of Databricks-based solutions.
- Design and implement end-to-end data pipelines and distributed data processing solutions.
- Provide advanced technical support and troubleshooting for complex customer production issues.
- Collaborate with Project Managers, Architects, Data Engineers, and customer stakeholders to ensure successful technical delivery.
- Manage technical scope, dependencies, timelines, and delivery risks across projects.
- Mentor and provide technical guidance to junior data engineers and other team members.
- Conduct technical discussions, architecture reviews, and whiteboarding sessions with customers and internal teams.
- Handle complex technical challenges and customer conflicts with a solution-oriented approach.
- Travel up to 30%, based on customer and project requirements.
Required Technical Skills
- 6+ years of experience in data engineering, data platforms, and analytics, with significant experience working on Databricks.
- Strong experience with large-scale data migration projects involving Databricks.
- Hands-on experience with Apache Spark, including a strong understanding of distributed computing and Spark runtime internals.
- Strong programming experience in Python or Scala.
- Experience designing and deploying end-to-end, high-performance data architectures.
- Strong working knowledge of at least two major cloud platforms such as Azure, AWS, or GCP, with deep expertise in at least one.
- Experience with CI/CD and production deployment practices.
- Working knowledge of MLOps and production machine learning/data workflows.
- Hands-on experience deploying and integrating Databricks-based solutions in enterprise environments.
- Experience with data engineering, analytics, ETL/ELT, distributed processing, and modern cloud data platforms.
- Strong understanding of enterprise architecture, scalability, performance, reliability, and security considerations.
Consulting & Customer-Facing Experience
- Proven experience working directly with external customers or enterprise clients.
- Strong consulting mindset with the ability to understand business requirements and translate them into technical solutions.
- Experience managing technical discussions with senior customer stakeholders.
- Ability to manage competing priorities, technical challenges, and customer expectations.
- Experience delivering complex technical projects while managing scope, timelines, dependencies, and risks.
- Strong documentation, presentation, communication, and whiteboarding skills.
Certifications
- Databricks certification is mandatory.
What We're Looking For
- Strong architectural and problem-solving mindset.
- Excellent communication and stakeholder-management skills.
- Ability to independently own complex technical engagements.
- Strong collaboration skills across engineering, architecture, project management, and customer teams.
- Ability to mentor and influence engineering teams.
- Comfortable working in a fast-paced, customer-focused consulting environment.
- Willingness to travel up to 30% when required.
Role Highlights
- Work on large-scale enterprise data transformation initiatives.
- Solve complex data engineering and architecture challenges across industries.
- Work with Databricks, Apache Spark, and leading cloud platforms.
- Drive customer-facing projects from architecture through production deployment.
- Opportunity to influence modern data, analytics, and AI platform adoption.
- Work closely with senior technical and business stakeholders.
Requirements added by the job poster
• 5+ years of work experience with Azure Databricks
• 8+ years of work experience with Apache Spark