Description

You will develop and maintain data pipelines within the Hadoop ecosystem. This role requires managing data ingestion, processing, and orchestration using specific big data tools.

Responsibilities

• Develop and maintain scalable data pipelines using the Hadoop framework.
• Implement data processing tasks using PySpark and Apache Pig.
• Manage data ingestion and movement between systems using Sqoop.
• Orchestrate complex batch workflows with Apache Oozie.

Required Skills

• 5+ years of hands-on experience in Hadoop development.
• Proficiency with PySpark and Apache Pig for data processing.
• Experience using Sqoop and Apache Sqoop for data transfer.
• Working knowledge of Apache Oozie for workflow management.
• Proficiency with Apache Impala and Apache Kafka.
• Experience with Cassandra database technologies.
• Strong understanding of the Hadoop ecosystem.
• Bachelor's degree or equivalent graduate education.

Preferred Skills

• Experience working in a hybrid capacity in Jersey City, NJ.

Key Skills

Education

ANY GRADUATE