Description

Key Responsibilities

• Define the target-state architecture for enterprise data platforms and cloud-native analytics solutions.

• Lead the migration of large-scale data environments from on-premises platforms to a cloud environment.

• Design scalable, resilient, and secure data architectures capable of supporting petabyte-scale workloads.

• Establish architectural standards, governance frameworks, and engineering best practices.

• Partner with infrastructure, security, and application teams to ensure alignment with enterprise cloud strategies.

• Evaluate and recommend technologies for data storage, processing, streaming, governance, and observability.

• Provide technical leadership and mentorship to engineering teams implementing Spark, Kafka, Databricks, and cloud-native services.

• Drive performance optimization, cost management, and operational excellence across the data platform.

• Support executive stakeholders with migration roadmaps, risk assessments, and modernization strategies.

Required Qualifications

• 10+ years of experience in data platform architecture, data engineering, or distributed systems.

• Demonstrated experience leading enterprise-scale cloud migration initiatives involving hundreds of terabytes or petabytes of data.

• Strong experience with:

o Databricks

o Apache Spark

o Apache Kafka

o AMPS, MQ, Hadoop, or experience with other enterprise messaging systems

o AWS cloud services

o Large-scale data warehouse or lakehouse platforms

• Experience migrating data from platforms such as Vertica, Hadoop, Teradata, Oracle, Snowflake, or similar technologies.

• Strong software engineering background with expertise in:

o Java

o Python

o SQL (any flavor)

o Other object-oriented programming languages

• Experience designing highly available, scalable distributed systems.

• Strong understanding of data governance, security, compliance, and operational monitoring.

• Bachelor’s Degree

Preferred Qualifications

• Databricks certification(s)

• AWS Solutions Architect certification(s)

• Experience implementing lakehouse architectures.

• Experience designing streaming and real-time analytics platforms.

• Experience within highly regulated financial services or enterprise environments.

• Master’s Degree

Key Skills

Education

Bachelor's or Master's degrees