Description

Design and architect scalable enterprise data platforms using Databricks, leading cloud modernization initiatives across Azure, AWS, or GCP.

This role is remote.

Responsibilities

• Build and optimize Lakehouse architectures using Apache Spark and Delta Lake for analytics and AI/ML workloads.
• Implement Infrastructure as Code (IaC) using Terraform, Bicep, ARM, or similar tools to ensure platform reliability.
• Establish best practices for data governance, security, and platform management.
• Collaborate with engineering teams and business stakeholders to deliver enterprise-grade solutions.

Required Skills

• 5+ years of experience in Data Engineering and Enterprise Data Architecture.
• Deep expertise with Databricks, Apache Spark, and Delta Lake.
• Proficiency in Cloud Architecture (Azure, AWS, or GCP).
• Hands-on experience with Infrastructure as Code tools: Terraform, Bicep, or ARM templates.
• Strong Python programming skills.
• Experience with Azure Data Factory (ADF).
• Familiarity with Unity Catalog for data governance.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree