Description

You will manage, optimize, and secure the Databricks platform to ensure performance, scalability, and compliance.

This role is on-site.

Responsibilities

• Configure and manage Databricks clusters to balance cost and performance against project requirements.
• Design, implement, and troubleshoot scalable data processing pipelines using Apache Spark.
• Monitor cluster health, implement logging solutions, and perform regular maintenance and patching.
• Analyze consumption reports to identify and correct abnormal usage patterns.
• Document configurations and best practices, providing technical support to internal teams.

Required Skills

• 5+ years of experience in a Databricks Engineer or similar platform administration role.
• Strong proficiency in Databricks and Apache Spark.
• Experience with cloud platforms: AWS, Azure, or GCP.
• Proficiency in Python, Scala, or Java programming.
• Strong SQL skills and understanding of data architecture and ETL processes.
• Experience with system integration and Databricks support.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Databricks Certification.
• Experience with big data technologies, distributed computing, and machine learning frameworks.

Key Skills

Education

Any Graduate