Description

Role Overview

Join a high-impact enterprise data engineering team building scalable Azure-based data platforms that power analytics, reporting, and large-scale data transformation initiatives.

Why This Role Matters

This role is critical in modernizing our enterprise infrastructure and enabling scalable analytics. As a Senior Data Architect, you will be responsible for designing and building reference architectures, creating how-to's, and productionalizing customer use cases.

What You'll Do

* Handle a variety of impactful customer technical projects that may include designing and building reference architectures, creating how-to's, and productionalizing customer use cases

* Work with engagement managers to scope variety of professional services work with input from the customer

* Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build, and deployment of industry-leading big data and AI applications

* Consult on architecture and design; bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation, and adoption of Databricks.

* Provide an escalated level of support for customer operational issues

* Collaborate with the Project Manager, Architect, and Customer teams to ensure the technical components of the engagement are delivered to meet customer needs

* Mentor and provide guidance to junior data engineers and team members.

Core Technical Requirements

* 7+ years experience in data engineering, data platforms & analytics on Databricks platform

* Experience with large scale data migrations to/from Databricks

* Consulting / customer facing experience, working with external clients across a variety of industry markets

* Comfortable writing code in either Python or Scala

* Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one

* Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals

* Familiarity with CI/CD for production deployments

* Working knowledge of MLOps

* Design and deployment of performant end-to-end data architectures

* Experience with technical project delivery - managing scope and timelines

* Documentation and white-boarding skills

* Experience working with clients and managing conflicts

* Deployment and integration of Databricks-based solutions to complete customer projects

* Must have Databricks Certifications

* Strong communication and collaboration skills

* Excellent problem-solving skills

* Ability to travel up to 30% when needed

Requirements added by the job poster

• 3+ years of work experience with PySpark

• 2+ years of work experience with Python (Programming Language)

• 5+ years of work experience with Azure Databricks

Key Skills

Education

Any Graduate