Description

Lead architectural design and project management for large-scale data engineering implementations.

This role is remote.

Responsibilities

• Lead end-to-end project delivery and architectural design for data platforms.
• Design and develop data solutions using Databricks, Spark, and Delta Lake.
• Optimize data pipelines for performance, scalability, and efficiency.
• Implement CI/CD workflows for production deployments.
• Apply MLOps principles to data and machine learning workflows.

Required Skills

• 10+ years of consulting experience.
• 7+ years of experience in data engineering, data platforms, and analytics.
• Databricks Data Engineering Professional certification.
• Deep expertise in Spark runtime internals and distributed computing.
• Hands-on development across 6-8+ completed Databricks projects.
• Expertise in at least one major cloud ecosystem (AWS, Azure, or GCP).
• Working knowledge of multiple cloud environments (AWS, Azure, GCP).
• Proficiency with PySpark, Delta Lake, and Spark tuning.
• Experience with CI/CD and MLOps.

Preferred Skills

• Broad knowledge across the entire Databricks product and platform feature set.

Key Skills

Education

Any Graduate