Description

You will design and implement scalable data solutions using Databricks, owning the full lifecycle from architecture to optimization.

This role is on-site.

Responsibilities

• Lead the design and implementation of high-performance data solutions using Databricks.
• Oversee the integration of Databricks Delta Lake to manage and optimize large datasets.
• Develop complex queries and data models using Databricks SQL.
• Monitor and optimize data pipelines to ensure data quality and reliability.
• Implement data governance and security protocols to ensure industry compliance.

Required Skills

• 10+ years of experience in data engineering.
• Extensive experience with Databricks and Spark in Scala.
• Proficiency in Databricks Delta Lake.
• Expertise in Databricks SQL.
• Strong understanding of data architecture and engineering principles.
• Experience developing and optimizing data pipelines.
• Proficiency in Python.

Preferred Skills

• Proven ability to troubleshoot complex data issues.
• Mentor junior team members and conduct regular code reviews to ensure best practices.

Key Skills

Education

Any Graduate