Description

You will design and manage data platform infrastructure with a focus on Databricks and large-scale data processing.

Responsibilities

• Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
• Collaborate with data engineers and data scientists to implement data processing pipelines.
• Optimize Databricks jobs for performance and scalability to handle big data workloads.
• Monitor and troubleshoot Databricks jobs to identify and resolve bottlenecks.
• Implement best practices for data management, security, and governance within the Databricks environment.

Required Skills

• 5+ years of experience in infrastructure architecture.
• Hands-on experience with the Databricks platform.
• Extensive PySpark coding experience.
• Proficiency with Terraform and Python.
• Experience with Azure and Snowflake.
• Strong quantitative and analytical problem-solving aptitude.
• Ability to work in a collaborative team environment.
• Any Graduate degree.

Key Skills

Education

Any Gradute