← Back to jobs

Photon Interactive UK Limited Logo
Senior Hadoop Data Engineer

Photon Interactive UK Limited

 

Irvington, NJ, USA

Posted On: 6 days ago
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Senior Hadoop Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Lead complex Big Data projects and manage competing priorities within large-scale environments.

This role is on-site.

Responsibilities

  • Design, install, configure, and monitor services across the Cloudera CDH/CDP stack.
  • Manage cluster setup, capacity planning, security, and performance tuning.
  • Administer and support RHEL Linux operating systems, databases, and hardware in enterprise environments.
  • Implement and manage Hadoop cluster security using Kerberos integrated with LDAP/AD.
  • Optimize resource separation across storage, memory, network, and compute layers.

Required Skills

  • 5+ years of experience with large-scale Enterprise Hadoop or Big Data environments (Databricks, Cloudera, or HD Insights).
  • Deep understanding of HDFS, MapReduce, Kafka, Spark, Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie.
  • Hands-on experience with RHEL Linux administration and enterprise database management.
  • Proficiency in shell scripting (Bash, ksh, etc.) for debugging and performance tuning.
  • Expertise in storage capacity management and system administration.
  • Experience configuring security for Hadoop clusters via Kerberos and LDAP/AD.

Preferred Skills

  • Experience with AWS, Azure, or Google Cloud distributions.
  • Proficiency in Python, Java, or R.
  • Experience with Git version control and Spectrum Conductor.

Education

ANY GRADUATE

Related Jobs

No related jobs found

← Back to jobs