Description
Administer and engineer Big Data platforms across multiple Hadoop, HBase, and Spark clusters. Own the production environment, ensuring scalability, stability, and adherence to performance SLAs.
Responsibilities
- Monitor platform health, generate performance reports, and drive continuous operational improvements.
- Perform capacity planning, optimization, and debugging for Big Data clusters.
- Implement security remediation, automation, and self-healing mechanisms.
- Collaborate with development and engineering teams to ensure production deliverables.
Required Skills
- 5+ years of experience in Big Data administration and engineering.
- Deep expertise with Hadoop (HDFS and YARN).
- Proficiency in Hive, Spark, and Livy.
- Experience managing HBase and Solr.
- Hands-on knowledge of Oozie, Kafka, Airflow, and NiFi.
- Strong skills in performance tuning and troubleshooting.