Description

Build and optimize big data processing applications using Java and Apache Spark for batch and streaming workloads.

Responsibilities

• Develop and maintain Java-based applications for big data processing.
• Build and optimize data pipelines using Apache Spark for both batch and streaming.
• Integrate Spark solutions into enterprise systems alongside data engineers and architects.
• Ensure scalability, performance, and reliability of distributed applications.
• Troubleshoot and resolve issues in Spark jobs and data workflows.

Required Skills

• Core Java and Java 8+ proficiency.
• Hands-on experience with Apache Spark (RDDs, DataFrames, Spark SQL, Streaming).
• Knowledge of Hadoop ecosystem components (HDFS, Hive, Kafka).
• Experience with Microservices architecture and containerization (Docker/Kubernetes).
• Familiarity with SQL/NoSQL databases for data integration.
• 6+ years of working experience.

Preferred Skills

• Exposure to cloud platforms (AWS, Azure, GCP).
• Experience with real-time data processing and ETL pipelines.

Key Skills

Education

Any Graduate