Description

Key Skills: Cloudera, Apache Spark, Apache Kafka, Hadoop, HDFS, YARN, Hive, HBase, Cloudera Manager, CDP

Good to Have Skills: Experience with cluster upgrades, patch management, capacity planning, performance tuning, troubleshooting data processing issues, monitoring tools, fault tolerance implementation, and data consistency management.

Roles & Responsibilities:

• Install, configure, and manage Cloudera Data Platform (CDP) and CDH environments.
• Monitor cluster health and performance using Cloudera Manager and other monitoring tools.
• Perform cluster upgrades, patch management, and capacity planning for optimal system performance.
• Manage and maintain HDFS, YARN, Hive, and HBase components within the ecosystem.
• Deploy and maintain Spark clusters for batch and real-time data processing requirements.
• Optimize Spark jobs through memory management and execution tuning for better performance.
• Install and configure Apache Kafka clusters with proper topics, partitions, and replication factors.
• Monitor Kafka brokers to ensure fault tolerance, data consistency, and optimal throughput.
• Troubleshoot performance issues including lag, throughput problems, and consumer-related issues

Key Skills

Education

Any Graduate