Description

You will serve as the primary technical authority for Databricks platform projects, owning scalable data pipelines and governance policies.

This role is on-site.

Responsibilities

• Design and implement secure, efficient data architectures and ETL/ELT pipelines on Databricks.
• Develop and deploy machine learning models and data processing workflows.
• Optimize cluster configurations, Spark jobs, and overall environment performance and cost.
• Enforce data security compliance, governance policies, and data quality standards.
• Review code and workflows to ensure adherence to technical standards and best practices.

Required Skills

• 10+ years of professional experience in data engineering leadership roles.
• Expert proficiency in Python for data processing.
• Deep experience with Apache Spark for large-scale data workloads.
• Proven track record designing data pipelines using Databricks.
• Experience optimizing Spark jobs for performance and cost efficiency.
• Strong knowledge of Data Lakehouse Architecture and Delta Lake.
• Hands-on experience with ETL processes and data governance.
• Ability to translate business requirements into technical solutions.

Key Skills

Education

Any Graduate