Description

Responsibilities:

• Provide L3 support for the Hadoop platform, troubleshooting and resolving issues to ensure high availability and performance.
• Manage and maintain the Hadoop Distributed File System (HDFS), ensuring data integrity and security.
• Collaborate with data scientists and analysts to understand data requirements and optimize data pipelines.
• Implement and monitor data ingestion processes, ensuring efficient data flow from various sources into the Hadoop ecosystem.
• Work with GCP services to integrate cloud-based solutions with on-premises Hadoop infrastructure.
• Develop and maintain documentation for data engineering processes, including data models, workflows, and system configurations.
• Participate in capacity planning and performance tuning of the Hadoop environment.
• Stay updated with the latest industry trends and technologies related to data engineering and Hadoop.

Mandatory Skills:

• Strong knowledge of Hadoop Distributed File System (HDFS) and its architecture.
• Hands-on experience with L3 support and maintenance of Hadoop platforms.
• Proficiency in managing and optimizing data workflows within the Hadoop ecosystem.
• Familiarity with Google Cloud Platform (GCP) and its data services.
• Experience with data ingestion tools and techniques.

Preferred Skills:

• Knowledge of additional big data technologies such as Apache Spark, Hive, or Pig.
• Experience with data modeling and ETL processes.
• Familiarity with programming languages such as Python, Java, or Scala.
• Understanding of data governance and security best practices.
• Experience with containerization technologies like Docker or Kubernetes.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Relevant certifications in Hadoop or cloud technologies are a plus.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities

Key Skills

Education

Bachelor's degree