Description

Build and maintain large-scale data processing applications and streaming architectures.

You will own the release pipeline.

Responsibilities

• Develop data processing applications using Apache Spark and PySpark.
• Build and manage producer/consumer applications using Kafka.
• Write complex, efficient SQL queries for data manipulation and analysis.
• Work within Hadoop ecosystems including MapR and HDFS.

Required Skills

• 6+ years of experience with Big Data technologies including Hadoop, MapR, HDFS, and Hive.
• 6+ years of experience developing applications with Apache Spark (PySpark).
• 5+ years of experience creating producer/consumer applications with Kafka.
• 5+ years of experience with Python coding and scripting.
• 5+ years of experience writing complex and efficient SQL.
• Any graduate degree.

Key Skills

Education

ANY GRADUATE