← Back to jobs

Kaizen Technologies, Inc Logo
Java Spark Engineer

Kaizen Technologies, Inc

 

Berkeley Heights, NJ, USA

Posted On: Just posted
Experience: 7+ years
Availability: Remote
Openings: 1
Category: Spark Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Architect and build scalable, fault-tolerant data pipelines using Apache Spark in Java, owning production reliability and performance optimization for terabyte-scale systems.

This role is remote.

Responsibilities

  • Design and implement batch and streaming ETL/ELT systems handling large data volumes.
  • Perform deep-dive performance tuning including partitioning strategy, memory management, and shuffle/skew optimization.
  • Lead code and design reviews, setting technical standards and driving decisions on data architecture and storage formats.
  • Mentor mid-level and junior engineers while serving as the technical escalation point for pipeline failures.
  • Own production reliability through on-call rotations, incident response, and root-cause analysis.

Required Skills

  • 7+ years of professional Java development experience.
  • 5+ years of hands-on experience with Apache Spark in production environments.
  • Expert-level understanding of distributed systems, including fault tolerance, data locality, and resource management.
  • Strong SQL skills and familiarity with columnar storage formats (Parquet, ORC, Avro, Delta Lake, or Iceberg).
  • Experience with cluster managers such as YARN or Kubernetes, including cloud-managed Spark.
  • Proficiency with Kafka for streaming data integration.
  • Strong grasp of CI/CD, containerization, and infrastructure-as-code practices.
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Preferred Skills

  • Experience with Flink or other stream-processing frameworks.
  • Familiarity with data governance, lineage, and quality frameworks.
  • Background in system design for multi-tenant or multi-region data platforms.

Education

Bachelor's or Master's degrees

Related Jobs

No related jobs found

← Back to jobs