Description

You will design, develop, and maintain scalable data processing solutions using Apache Spark and Scala.

This role is hybrid.

Responsibilities

• Write and optimize Spark jobs for performance in batch and real-time frameworks.
• Build and manage data pipelines using Databricks, Snowflake, and Kafka.
• Develop and optimize SQL queries for extraction, transformation, and loading.
• Produce unit tests for Spark transformations to ensure data quality.
• Monitor and troubleshoot data processing issues.

Required Skills

• 6+ years of experience with Apache Spark in Scala.
• Hands-on experience with Databricks and on-prem Hadoop clusters.
• Proficiency with Snowflake for data warehousing.
• Experience with Kafka for real-time data streaming.
• Strong command of SQL and Unix environments.
• Deep understanding of functional programming and RESTful APIs.
• Any Graduate degree.

Preferred Skills

• Experience implementing both batch and real-time data processing frameworks.

Key Skills

Education

Any Graduate