← Back to jobs

Photon Interactive UK Limited Logo
Hadoop Data Engineer
Posted On: 2 days ago
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Hadoop Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will manage and optimize large-scale enterprise Big Data environments and Hadoop clusters.

This role is on-site.

Responsibilities

  • Design, install, configure, and monitor all services within the Cloudera CDH/CDP stack.
  • Manage cluster setup, capacity planning, security, and performance tuning.
  • Administer RHEL Linux operating systems, databases, and hardware in an enterprise environment.
  • Implement and manage Hadoop cluster security using Kerberos with LDAP/AD integration.
  • Lead complex projects involving storage, memory, network, and compute resource separation.

Required Skills

  • 5+ years of experience with large-scale Enterprise Hadoop, Databricks, Cloudera, or HD Insights.
  • Deep understanding of HDFS, MapReduce, Kafka, Spark, Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie.
  • Proficiency in shell scripting including Bash or ksh.
  • Experience with system administration tasks such as storage capacity management and debugging.
  • Strong knowledge of operating system integration and clustered compute.
  • Ability to manage large-scale enterprise resource separation across storage, memory, network, and compute.

Preferred Skills

  • Experience with Python, Java, R, AWS, Azure, or Google Cloud platforms.
  • Background in Databricks, SAS, Search, Machine Learning, or Log Aggregation.
  • Experience with version control systems such as Git.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs