Description

Provide L3 support for the Hadoop platform, ensuring high availability, performance, and data integrity.

This role is on-site.

Responsibilities

• Troubleshoot and resolve complex Hadoop platform issues to maintain system stability.
• Manage and maintain HDFS, ensuring data security and integrity.
• Collaborate with data scientists to optimize data pipelines and ingestion processes.
• Integrate GCP cloud services with on-premises Hadoop infrastructure.
• Participate in capacity planning and performance tuning of the Hadoop environment.

Required Skills

• 5+ years of experience in Hadoop platform support and maintenance.
• Strong knowledge of HDFS architecture and management.
• Proficiency in managing and optimizing data workflows within the Hadoop ecosystem.
• Hands-on experience with Google Cloud Platform (GCP) data services.
• Experience with data ingestion tools and techniques.
• Proficiency in Python, Java, or Scala.
• Familiarity with containerization technologies like Docker or Kubernetes.

Preferred Skills

• Knowledge of Apache Spark, Hive, or Pig.
• Experience with data modeling, ETL processes, and data governance.

Key Skills

Education

Bachelor's degree