Description

You will design and maintain complex software applications and data pipelines within the Hadoop ecosystem, focusing on real-time stream processing and optimized data algorithms.

This role is hybrid.

Responsibilities

• Design and implement Apache Spark-based real-time stream processing data pipelines.
• Develop applications using Big Data technologies including Kafka, Cassandra, and Apache Spark.
• Implement complex, optimized data processing algorithms in real time using Scala or Java.
• Perform Proof-of-Concept evaluations for new technologies.
• Collaborate with business analysts and technology delivery managers to implement system architecture.

Required Skills

• 9+ years of total industry experience with 4-5 years in Big Data.
• Proficiency in Core Java, J2EE, and C++.
• Hands-on experience with Cloudera Hadoop ecosystems (HDFS, YARN, Hive, HBase, Sqoop, Spark, Hue).
• Experience with real-time streaming using Kafka.
• Working knowledge of Cassandra and Apache Spark.
• Proficiency in at least one scripting language: Python, Unix Shell Scripting, or PERL.
• Understanding of Hadoop Cluster Architecture.
• Experience working within Agile and Scrum methodologies.

Preferred Skills

• Experience with Big Data Analytics and Business Intelligence tools using R or Python.

Key Skills

Education

Any Graduate