Description

You will design and implement scalable data pipelines and big data applications within a Cloudera ecosystem.

Responsibilities

• Design, develop, and implement scalable data pipelines using Hadoop, Spark, Hive, Impala, and HDFS.
• Write and optimize ETL processes to load data into data lakes or warehouses.
• Manage Cloudera clusters, including setup, configuration, monitoring, and performance optimization via Cloudera Manager.
• Develop applications for both batch and real-time data processing using Spark and MapReduce.
• Implement security measures and data governance using Apache Ranger and Sentry.

Required Skills

• 5+ years of experience in big data development.
• Cloudera ecosystem expertise.
• Hadoop and HDFS.
• Apache Spark.
• Hive and Impala.
• ETL processes.
• HBase.
• MapReduce.
• Apache Ranger and Sentry.

Preferred Skills

• Troubleshoot and resolve performance bottlenecks in data pipelines and Spark jobs.
• Integrate Cloudera solutions with external databases and APIs.

Key Skills

Education

Any Graduate