Description

You will design and implement scalable data pipelines and big data applications within the Cloudera ecosystem.

This role is hybrid.

Responsibilities

• Design and implement scalable data pipelines using Hadoop, Spark, Hive, Impala, and HDFS.
• Write and optimize ETL processes to load data into data lakes or warehouses.
• Manage Cloudera clusters, including setup, configuration, monitoring, and performance optimization via Cloudera Manager.
• Develop applications for both batch and real-time data processing using Spark and MapReduce.
• Implement security measures and data governance using Apache Ranger and Sentry.

Required Skills

• 5+ years of experience in big data development.
• Expertise in the Cloudera ecosystem.
• Strong proficiency with Hadoop and HDFS.
• Experience with Apache Spark.
• Knowledge of Hive and Impala.
• Hands-on experience with ETL processes.
• Familiarity with HBase.
• Understanding of MapReduce.
• Experience with Apache Ranger and Sentry.

Preferred Skills

• Ability to troubleshoot and resolve performance bottlenecks in data pipelines and Spark jobs.
• Experience integrating Cloudera solutions with external databases and APIs.

Key Skills

Education

Any Graduate