Description

You will own the design, deployment, and operation of data processing infrastructure.

Responsibilities

• Lead installation and configuration of Databricks on GCP platforms.
• Design and develop scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake.
• Monitor platform health, performance, and cost optimization.
• Provide L2/L3 support, troubleshooting cluster failures and job errors.
• Maintain technical documentation for platform setup and development standards.

Required Skills

• 10+ years of professional experience.
• Expertise in PySpark development.
• Strong proficiency in SQL.
• Hands-on experience with Delta Lake.
• Experience with GCP cloud platform administration.
• Deep knowledge of Databricks administration and usage.

Key Skills

Education

Any Gradute