Description

You will develop and support large-scale data platforms using Java and Spark.

This role is hybrid.

Responsibilities

• Support the Data Replication Service (Spark jobs) and develop features or bug fixes.
• Debug and fix issues in SparkCp (a library) encountered by the DRS.
• Debug and fix issues in the CDH Migration Tool encountered by customers.
• Implement monitoring and alerting improvements for the three mentioned tools.
• Perform onboarding tasks to move customer data and monitor/address user requests.

Required Skills

• 6+ years of overall software development experience.
• 3+ years in large-scale data platforms.
• Expertise in Spark and Java.
• Experience with Git and CI/CD workflows.
• Knowledge of Docker and Kubernetes for containerization.
• Familiarity with Parquet, Avro, Hive, or Iceberg.
• Proven ability in debugging and troubleshooting complex systems.
• Experience with Software Development principles.

Preferred Skills

• Golang experience.

Key Skills

Education

Any Gradute