Description

You will build and maintain large-scale data processing systems using Java and Spark.

Responsibilities

  • Develop data pipelines using Spark and Java to process large datasets.
  • Manage and optimize big data workflows within the Apache Hadoop ecosystem.
  • Implement real-time data streaming solutions using Kafka.
  • Write and optimize complex SQL queries for data extraction and analysis.
  • Integrate and maintain APIs for data access and system connectivity.

Required Skills

  • 5+ years of professional experience in data engineering.
  • Strong proficiency in Java.
  • Hands-on experience with Apache Spark.
  • Experience working with Big Data technologies and Apache Hadoop.
  • Expertise in Kafka for data streaming.
  • Advanced SQL skills.
  • Experience developing and consuming APIs.
  • Bachelor's degree or equivalent experience.

Education

Any Graduate