Description

Role Summary

Looking for a Senior/Lead Cloudera/Hadoop Migration Engineer who can lead migration projects from on-premises Hadoop/Cloudera to AWS. The candidate should have strong technical skills, leadership ability, and excellent communication with multiple teams.

Must-Have Skills:

10+ years of experience with Hadoop/Big Data and enterprise application design

Strong hands-on experience with Cloudera Hadoop

Strong knowledge of HDFS, Hive, Spark, Oozie, and Python

Strong AWS Big Data experience

Experience migrating on-premises Cloudera/Hadoop to AWS

Experience with AWS EMR, Glue, Airflow, and Lambda

Strong Bash/Shell scripting

Experience with Terraform / Infrastructure as Code

Experience with data migration, application re-platforming, testing, and validation

Knowledge of cloud security, governance, compliance, scalability, and performance

5+ years of experience with tools such as Bitbucket, Gradle, Octopus, and Artifactory

Knowledge of XML/JSON

Monitoring and logging experience

Strong communication and stakeholder management skills

Experience creating migration plans, technical documentation, and runbooks

Ability to mentor engineers and provide technical leadership

Key Responsibilities:

Analyze existing Cloudera/Hadoop architecture and data pipelines

Develop and execute Hadoop-to-AWS migration strategies

Design AWS solutions using EMR, Glue, Airflow, Lambda, etc.

Lead data migration, application re-platforming, testing, and validation

Ensure performance, scalability, security, and reliability

Troubleshoot platform, software, and data-pipeline issues

Work with Engineering, Infrastructure, DevOps, QA, Product, Content, and Business teams

Prepare migration plans, documentation, and operational runbooks

Mentor engineers on AWS Big Data and engineering best practices

Key Skills

Education

Any Graduate