Description

Design, implement, and maintain high-performing Hadoop clusters integrated with existing infrastructure.

Responsibilities

• Monitor data from various sources and review Hadoop log files for anomalies.
• Transfer code between different environments and schedule jobs on the Hadoop cluster.
• Analyze Hadoop clusters and big data analytic tools to optimize performance.
• Work with Parquet file formats and compression techniques such as bz2 and Snappy.
• Design and implement scalable Hadoop cluster architectures.

Required Skills

• 5+ years of experience in big data environments.
• Hands-on experience with Hive and HBase.
• Ability to schedule jobs on a Hadoop cluster.
• Experience designing and implementing Hadoop clusters.
• Knowledge of Parquet file formats.
• Familiarity with bz2 and Snappy compression techniques.
• Proficiency with big data analytic tools.

Education

• Master's Degree in Computer Science, Application, Electronics, Engineering, Information Systems, or a related field.

Key Skills

Education

Masters Degree in Computer Science/Application, Electronics, Engineering, Information Systems, or related