Description

You will design, build, and maintain large-scale distributed data processing solutions and streaming pipelines in San Jose, CA.

Responsibilities

• Design, code, test, and document big data-oriented software applications.
• Manage data ingestion, cleaning, and manipulation across operational and analytics databases.
• Build large-scale near real-time streaming data processing pipelines.
• Implement and optimize distributed solutions using Hadoop, Spark, and Hive in on-premise and cloud environments.
• Develop BI and visualization tools to capture and analyze data from multiple sources.

Required Skills

• 7+ years of experience in big data development.
• Proficiency in Java and Python.
• Hands-on experience with Spark, Hive, and HBase.
• Deep understanding of the Hadoop ecosystem, including MapReduce, HDFS, YARN, and Pig.
• Experience with Hadoop development and QA processes.
• Knowledge of Hortonworks and Cloudera technologies.
• Experience with security frameworks such as Kerberos and LDAP.
• Experience with NFS (preferably ONTAP) and shared file systems.
• Any Graduate degree.

Preferred Skills

• Knowledge of C programming.
• Experience with Storm, Kafka, and Elastic Search.
• Familiarity with Ranger and Sentry.

Key Skills

Education

Any Graduate