Description

You design, develop, and deploy scalable batch and streaming data pipelines on the Databricks Lakehouse Platform.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using PySpark, Spark SQL, and Delta Live Tables.
• Implement complex data transformations and business logic following the Medallion Architecture.
• Design data quality frameworks and cleansing routines to ensure reliability.
• Monitor, debug, and tune Databricks jobs and Spark clusters for performance and cost optimization.
• Partner with DevOps to manage Databricks environments and job deployments via Infrastructure as Code.

Required Skills

• 5+ years of experience with Python and PySpark.
• Deep hands-on expertise with the Databricks Lakehouse Platform.
• Strong knowledge of data modeling principles and data warehousing concepts.
• Proven experience with a major cloud platform.
• Experience implementing data governance using Databricks Unity Catalog.

Preferred Skills

• Databricks Certified Data Engineer – Professional certification.
• Experience with Terraform or other IaC tools.
• Background delivering data solutions in retail or e-commerce.

Key Skills

Education

Any Graduate