Description

You will design and operationalize Databricks-based data and analytics solutions, partnering with Product Managers and Data Scientists to bring prototypes to production.

This role is remote.

Responsibilities

• Design and build scalable data pipelines in batch and real-time using Databricks, Spark, and SQL.
• Develop and maintain code in Scala and Python, ensuring correctness with pragmatic automated tests.
• Review code and designs to promote engineering quality and best practices.
• Facilitate technical problem diagnosis and resolution across functional areas.
• Participate in agile workflows and coordinate Communities of Practice.

Required Skills

• 5+ years of experience in Big Data and distributed systems.
• 2+ years of hands-on experience with Databricks, Spark, Scala, and Python.
• Strong proficiency in SQL, Hive, and data modeling.
• Experience with data visualization tools such as Power BI.
• Deep understanding of software development best practices and Agile methodologies.
• Ability to work independently on complex problems and communicate clearly.
• Bachelor’s degree in Computer Science, Engineering, or equivalent demonstrable experience.

Preferred Skills

• Experience with streaming technologies (Spark Streaming, Kafka) and Lambda Architecture.
• Databricks certification.

Key Skills

Education

Any Graduate