Description

You will design and develop data processing pipelines and analytics solutions on the Databricks platform.

This role is remote.

Responsibilities

• Architect scalable data models and storage solutions.
• Collaborate with architects to migrate existing solutions to Databricks.
• Optimize Databricks cluster and job performance to meet SLAs.
• Mentor junior engineers and provide technical guidance.

Required Skills

• 8+ years of overall software engineering experience.
• 3+ years of experience designing and implementing data solutions on Databricks.
• Proficiency in Python, Scala, or SQL.
• Strong understanding of distributed computing and Apache Spark.
• Experience with cloud platforms including AWS, Azure, or GCP.
• Bachelor's or Master's degree in Computer Science or Engineering.
• Experience with data governance, security, and compliance practices.

Preferred Skills

• Experience with containerization using Docker and Kubernetes.
• Knowledge of DevOps practices for automated deployment and monitoring.

Key Skills

Education

Bachelor's or Master's degree in Computer Science, Engineering