Description

You will design and implement big data solutions within an enterprise architecture, owning the full lifecycle from data pipeline development to release management.

Responsibilities

• Develop and maintain data pipelines using the Hadoop stack and storage technologies.
• Design ETL processes and perform data analysis across distributed systems.
• Manage code deployment and release processes within established team cadences.
• Evaluate new technologies to improve distributed computing implementations.
• Collaborate with architects and stakeholders to deliver business-critical applications.

Required Skills

• 8+ years of experience with the Hadoop stack, including HDFS, MapReduce, Yarn, Hive, Sqoop, and Impala.
• Strong proficiency in Spark, Flume, Kafka, and Oozie.
• Extensive knowledge of Big Data Enterprise architecture, preferably Cloudera.
• Hands-on experience with HBase, RDBMS, and SQL.
• Experience with NoSQL technologies such as Cassandra or MongoDB.
• Proficiency in Unix/Linux scripting and AutoSys scheduling.
• Deep understanding of distributed computing principles and algorithms.

Preferred Skills

• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate