Description

You will lead architectural design and project management for large-scale data engineering implementations.

Responsibilities

• Lead and manage end-to-end project delivery alongside architectural responsibilities.
• Design and develop data platforms using Databricks and Spark.
• Optimize data pipelines for performance and scalability.
• Implement CI/CD workflows for production deployments.
• Apply MLOps principles to data and machine learning workflows.

Required Skills

• 10+ years of consulting experience.
• 7+ years of experience in data engineering, data platforms, and analytics.
• Databricks Data Engineering Professional certification.
• Deep expertise in Spark runtime internals and distributed computing.
• Hands-on development experience across 6-8+ completed Databricks projects.
• Expertise in at least one major cloud ecosystem (AWS, Azure, or GCP).
• Working knowledge of multiple cloud environments (AWS, Azure, GCP).
• Proficiency with PySpark, Delta Lake, and Spark tuning.
• Experience with CI/CD and MLOps.

Preferred Skills

• Broad knowledge across the entire Databricks product and platform feature set.

Key Skills

Education

Any Graduate