← Back to jobs

Smarc Solutions Logo
Big Data Engineer

Smarc Solutions

 

Pleasanton, CA, USA

Posted On: 13 days ago
Experience: 5+ years
Availability: Remote
Openings: 1
Category: Big Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design, implement, and manage scalable big data solutions and cloud platforms.

This role is remote.

Responsibilities

  • Develop Hadoop systems and implement ELT processes to load and pre-process disparate data sets using Hive or Pig.
  • Build cloud platforms for application development and maintain production systems.
  • Collaborate with software R&D teams and manage communications between internal systems and survey vendors.
  • Meet with managers to define big data requirements and finalize system scope.
  • Train staff on data resource management.

Required Skills

  • 5+ years of experience as a Big Data Engineer.
  • In-depth knowledge of Hadoop and Spark frameworks.
  • Proficiency with Hive and Pig for data pre-processing.
  • Strong scripting skills in Java, Python, C++, Ruby, or PHP.
  • Experience working in Linux environments.
  • Knowledge of NoSQL and RDBMS databases, specifically Redis and MongoDB.
  • Familiarity with Mesos, AWS, and Docker.

Preferred Skills

  • Experience with R programming.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs