Description

You manage complex operations supporting multiple projects requiring deep technical expertise in data platform administration.

Responsibilities

• Manage day-to-day operations for platforms built on Hadoop, Spark, Kafka, Kubernetes/OpenShift, and Docker.
• Perform cluster management, upgrades, bug fixes, deployments, and disaster recovery activities.
• Own incident response, problem management, and capacity planning for platform services.
• Implement monitoring, alerting, and forecasting solutions to ensure system reliability.
• Automate platform tasks using scripting and configuration management tools.

Required Skills

• 5+ years of experience in administering data platforms.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and Hadoop Administrator's role.
• Expert-level knowledge of Cloudera Hadoop components (HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YAARN, ZooKeeper, Postgres).
• Intimate knowledge of fully integrated AD/Kerberos authentication.
• Proficiency with scripting and automation using Python, Shell, and Ansible.
• Hands-on experience analyzing various Hadoop log files, compression, encoding, and file formats.
• Experience with monitoring, alerting, and job scheduling systems.
• Knowledge of databases including SQL, Cassandra, and Postgres.
• Experience in agile development environments.

Key Skills

Education

Any Graduate