Description

You will design, develop, and architect Hadoop applications and large-scale data processing infrastructure for the team in Olivette, MO.

Responsibilities

• Design and develop web-based platforms to process, store, and serve large volumes of data.
• Build and maintain data pipelines using the Hadoop ecosystem and RDBMS technologies.
• Cleanse and process large raw datasets to ensure data quality and availability.
• Develop proof of concepts for new technologies to evaluate distributed computing capabilities.
• Collaborate with front-end and database developers to align technical implementation with business requirements.

Required Skills

• 5+ years of experience in data development.
• Proficiency with Hive and Spark for data processing.
• Experience with Kafka for stream processing.
• Strong programming skills in Java or Python.
• Working knowledge of RDBMS technologies.
• Experience with the Hadoop ecosystem.
• Ability to analyze business requirements for complex projects.
• Bachelor’s degree in Computer Science, Computer Information Systems, or Information Technology.

Preferred Skills

• Exposure to machine learning techniques.

Key Skills

Education

Any Graduate