Description

You manage complex operations for data platforms built on Hadoop, Spark, Kafka, Kubernetes/OpenShift, and Docker.

This role is on-site.

Responsibilities

• Manage day-to-day operations, including cluster management, upgrades, bug fixes, and deployments.
• Own incident response, problem management, and capacity planning for platform services.
• Perform disaster recovery activities and implement monitoring, alerting, and forecasting solutions.
• Automate platform tasks using scripting and configuration management tools.

Required Skills

• 5+ years of experience administering data platforms.
• Deep knowledge of Hadoop Architecture, HDFS, and Hadoop Cluster management.
• Expert-level proficiency with Cloudera components: HDFS, Sentry, HBase, Kafka, Impala, Solr, Hue, Spark, Hive, YARN, ZooKeeper, and Postgres.
• Intimate knowledge of fully integrated AD/Kerberos authentication.
• Proficiency in Python, Shell scripting, and Ansible.
• Hands-on experience analyzing Hadoop log files, compression, encoding, and file formats.
• Experience with monitoring, alerting, and job scheduling systems.
• Knowledge of SQL, Cassandra, and Postgres databases.
• Experience working in agile development environments.

Key Skills

Education

Any Graduate