Description

What's the Job?

• Design, develop, and optimize Spark-based applications for large-scale data processing.
• Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.
• Develop reusable frameworks and components supporting enterprise data engineering initiatives.
• Support migration efforts from on-premises data platforms to Databricks and AWS.
• Collaborate with architects and platform engineers to implement cloud-native data solutions.

What's Needed?

• 5+ years of hands-on development experience with Apache Spark.
• Strong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, and performance tuning.
• Experience integrating Spark with Apache Kafka.
• Strong development skills in Java and Python.
• Experience designing and supporting large-scale distributed systems

Key Skills

Education

Any Graduate