Description

You will design and oversee large-scale Hadoop architectures and data ecosystems.

Responsibilities

• Lead the migration from HDP to CDP environments.
• Architect data engineering pipelines to ingest, transform, and analyze large datasets.
• Design data marts for interactive browsing, querying, and exploration.
• Build operational databases optimized for low-latency OLTP use cases.
• Manage data security and governance across the Hadoop stack.

Required Skills

• 10+ years of IT experience.
• Deep proficiency in Hadoop architecture.
• Hands-on experience migrating HDP to CDP.
• Experience with HDFS, YARN, and YARN Queue Manager.
• Proficiency with Ranger and Atlas.
• Expertise in Hive metastore and Hive on Tez.
• Experience with Spark, Oozie, and Hue.
• Experience managing data services for ingestion and transformation.

Preferred Skills

• Strong experience with HBase for low-latency reads and writes.
• Experience with Impala and Data Analytics Studio (DAS).

Key Skills

Education

Any Graduate