Description

You will design and implement scalable data pipelines and infrastructure using Databricks.

Responsibilities

• Architect end-to-end data solutions integrating Databricks with cloud platforms (AWS, Azure, GCP).
• Collaborate with data scientists, engineers, and stakeholders to translate data requirements into technical solutions.
• Optimize and tune Databricks clusters to improve performance and reduce operational costs.
• Ensure data security, governance, and compliance across the Databricks environment.
• Troubleshoot and resolve technical issues related to the Databricks platform and its integrations.

Required Skills

• 6+ years of experience architecting large-scale data solutions using Databricks.
• Strong knowledge of Apache Spark and its ecosystem.
• Proficiency in Python, Scala, or SQL.
• Experience with cloud platforms including AWS, Azure, or Google Cloud Platform (GCP).
• Familiarity with ETL processes and data modeling principles.
• Strong understanding of data security and governance practices.
• Experience with SQL.

Key Skills

Education

Any Gradute