← Back to jobs

Consulting Pandits Logo
Big Data Engineer

Consulting Pandits

 

Pune, Maharashtra, India

Posted On: 15+ days ago
Experience: 5+ years
Availability: Hybrid
Openings: 1
Category: Big Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design and implement end-to-end data storage and processing pipelines.

This role is on-site.

Responsibilities

  • Develop and deploy end-to-end data processing pipelines.
  • Manage data workflows within Hadoop clusters.
  • Build and optimize data jobs using Apache Spark and Hive.
  • Maintain data integrity across RDBMS and distributed storage systems.

Required Skills

  • 5+ years of software development experience.
  • Proficiency in Java, Scala, or Python.
  • Intermediate expertise in Apache Spark, HDFS, and Hive.
  • Hands-on experience working with Hadoop clusters.
  • Foundational understanding of RDBMS.

Preferred Skills

  • Experience writing Spark jobs using Java.
  • Prior work with Cloudera Data Platform (CDP).
  • Experience with NoSQL databases such as HBase, Cassandra, or Elasticsearch.
Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs