Description

You will design and develop data processing pipelines and analytics solutions using Databricks.

Responsibilities

• Architect scalable data models and storage solutions on the Databricks platform.
• Collaborate with architects to migrate existing solutions to Databricks.
• Optimize Databricks cluster and job performance to meet SLAs and business requirements.
• Implement data governance, security, and compliance best practices.
• Mentor junior engineers and provide technical guidance.

Required Skills

• 4+ years of experience designing and implementing data solutions on Databricks.
• 9+ years of overall professional experience.
• Proficiency in Python, Scala, or SQL.
• Strong understanding of distributed computing and Apache Spark.
• Experience with AWS, Azure, or GCP and their associated data services.
• Proven ability to deliver scalable and reliable data solutions.
• Any Graduate degree.

Preferred Skills

• Experience with containerization technologies like Docker and Kubernetes.
• Knowledge of DevOps practices for automated deployment and monitoring.

Key Skills

Education

Any Graduate