Description

You will design and lead modern Lakehouse data platforms using Databricks.

This role is remote.

Responsibilities

• Architect and implement Databricks Lakehouse solutions for large-scale data platforms.
• Design and optimize batch and streaming data pipelines using Apache Spark (PySpark/SQL).
• Implement Delta Lake best practices including ACID, schema enforcement, and performance tuning.
• Build and manage Databricks jobs, workflows, notebooks, and clusters.
• Integrate Databricks with cloud data services like ADLS/S3, ADF, and Synapse.

Required Skills

• 15+ years in data engineering or data architecture.
• 5+ years of strong, hands-on experience with Databricks.
• Expertise in Apache Spark, PySpark, and SQL.
• Strong experience with Delta Lake and Lakehouse architecture.
• Proven cloud experience on Azure Databricks or AWS Databricks.
• Experience designing high-volume, scalable data pipelines.
• Familiarity with CI/CD practices using Azure DevOps or GitHub.
• Knowledge of Kafka for streaming integration.
• Understanding of data cataloging concepts.

Key Skills

Education

Any Graduate