Description

You will design, implement, and manage scalable big data solutions and cloud platforms.

Responsibilities

• Develop Hadoop systems and implement ELT processes to load and pre-process disparate data sets using Hive or Pig.
• Build cloud platforms for application development and maintain production systems.
• Collaborate with software R&D teams and manage communications between internal systems and survey vendors.
• Meet with managers to define big data requirements and finalize system scope.
• Train staff on data resource management.

Required Skills

• 5+ years of experience as a Big Data Engineer.
• In-depth knowledge of Hadoop and Spark frameworks.
• Proficiency with Hive and Pig for data pre-processing.
• Strong scripting skills in Java, Python, C++, Ruby, or PHP.
• Experience working in Linux environments.
• Knowledge of NoSQL and RDBMS databases, specifically Redis and MongoDB.
• Familiarity with Mesos, AWS, and Docker.
• Ability to solve complex networking, data, and software issues.
• Proven project management and communication skills.

Preferred Skills

• Experience with R programming.

Key Skills

Education

Any Graduate