Description

You will design, develop, and maintain complex software applications and data pipelines within the Hadoop ecosystem.

Responsibilities

• Design and implement Apache Spark-based real-time stream processing data pipelines.
• Develop applications using Big Data technologies including Kafka, Cassandra, and Apache Spark.
• Implement complex, optimized data processing algorithms in real time using Scala or Java.
• Perform Proof-of-Concept evaluations for new technologies.
• Collaborate with business analysts and technology delivery managers to implement system architecture.

Required Skills

• 9+ years of industry experience.
• 4-5 years of Big Data experience.
• Proficiency in Core Java, J2EE, and C++.
• Hands-on experience with Cloudera Hadoop ecosystems (HDFS, YARN, Hive, HBase, Sqoop, Spark, Hue).
• Experience with real-time streaming using Kafka.
• Working knowledge of Cassandra and Apache Spark.
• Proficiency in at least one scripting language: Python, Unix Shell Scripting, or PERL.
• Understanding of Hadoop Cluster Architecture.
• Experience working within Agile and Scrum methodologies.
• Strong analytical, problem-solving, and documentation skills.

Preferred Skills

• Experience with Big Data Analytics and Business Intelligence tools using R or Python.

Key Skills

Education

Any Graduate