Description

You will design, implement, and maintain Hadoop infrastructure on AWS, focusing on EMR.

Responsibilities

• Design, deploy, and maintain Hadoop clusters on AWS using EMR.
• Configure and tune HDFS, YARN, Hive, Spark, and HBase for performance.
• Monitor cluster health, troubleshoot issues, and ensure high availability.
• Implement security best practices to protect data and infrastructure.
• Automate routine tasks and processes to streamline operations.

Required Skills

• 5+ years of experience as a Hadoop Administrator or in a similar role.
• Proficiency in administering HDFS, YARN, Hive, Spark, and HBase.
• Hands-on experience with AWS services including EMR, EC2, S3, IAM, and CloudWatch.
• Strong Linux system administration skills.
• Experience with configuration management tools such as Ansible, Puppet, or Chef.
• Knowledge of cloud security concepts and best practices.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience optimizing data pipelines and workflows in collaboration with data engineers.

Key Skills

Education

Bachelor's degree in Computer Science