Description

You will design, develop, and maintain scalable data pipelines and big data applications within a Cloudera environment.

Responsibilities

• Design and implement scalable data pipelines using Hadoop, Spark, Hive, Impala, and HDFS.
• Develop applications for batch and real-time data processing using Apache Spark and MapReduce.
• Manage Cloudera clusters via Cloudera Manager, focusing on setup, configuration, and performance optimization.
• Implement data storage strategies using HDFS and HBase to improve retrieval performance.
• Secure data environments using Apache Ranger and Sentry to ensure policy compliance.
• Monitor and tune Hadoop and Spark jobs to resolve performance bottlenecks.
• Integrate Cloudera solutions with external databases, systems, and APIs.

Required Skills

• 5-10 years of experience in big data development.
• Expertise in Hadoop and Apache Spark.
• Proficiency with Hive and Impala.
• Experience with HDFS and HBase for data storage and management.
• Hands-on experience with MapReduce for large-scale data processing.
• Ability to use Cloudera Manager for cluster monitoring and high availability.
• Experience implementing security via Apache Ranger or Sentry.
• Any Graduate degree.

Key Skills

Education

Any Graduate