Description

Design and develop large-scale distributed data processing applications using Java and Apache Spark within the Cloudera Hadoop ecosystem.

This role is on-site.

Responsibilities

• Build and optimize ETL pipelines for large-scale big data workloads.
• Troubleshoot and optimize Spark applications to ensure high performance.
• Implement real-time data streaming and data warehousing workflows.
• Manage data processing infrastructure within Cloudera Hadoop.

Required Skills

• 10+ years of application development experience.
• Extensive hands-on experience with Java and Apache Spark.
• Proficiency in Spark SQL for distributed data processing.
• Experience with Cloudera Hadoop (CDH), including HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
• Working knowledge of SQL and NoSQL databases such as PostgreSQL and HBase.
• Familiarity with CI/CD pipelines using Jenkins and GitLab.
• Experience with version control tools like Git and Bitbucket.
• Understanding of data warehousing concepts, dimensional modeling, and data lakes.

Key Skills

Education

Any Graduate