Description

You will own the data infrastructure, optimizing large-scale processing jobs and maintaining pipeline integrity.

Responsibilities

• Optimize performance for Spark, HBase, and Hive jobs to ensure efficient data processing.
• Manage and maintain Cloudera and Hadoop infrastructure stability.
• Maintain data pipelines using SQOOP and Hive.
• Monitor system health and analyze logs using Splunk.

Required Skills

• 5+ years of experience in data engineering.
• Hands-on experience with Hadoop infrastructure.
• Proficiency with Cloudera management.
• Experience with Hive and SQOOP.
• Experience with HBase.
• Ability to optimize Spark job performance.
• Experience with Splunk for monitoring.
• Master’s degree in Information Systems or a related field.

Key Skills

Education

Master’s degree