Description

Develop and maintain data solutions within the Hadoop ecosystem, owning the full lifecycle from pipeline construction to release.

This role is on-site.

Responsibilities

• Build and manage data pipelines using the Hadoop stack and storage technologies.
• Implement ETL processes and perform data analysis across distributed systems.
• Manage code deployment and release cycles within established team cadences.
• Collaborate with architects and stakeholders to deliver business-critical applications.
• Evaluate new technologies to improve distributed computing implementations.

Required Skills

• 3-6 years of experience with HDFS, MapReduce, YARN, Hive, Sqoop, Impala, Spark, Flume, Kafka, and Oozie.
• Extensive knowledge of Big Data Enterprise architecture, preferably Cloudera.
• Hands-on experience with HBase, RDBMS, SQL, and ETL workflows.
• Proficiency in NoSQL technologies such as Cassandra or MongoDB.
• Experience with Unix/Linux scripting and AutoSys scheduling.
• Strong understanding of distributed computing principles.
• Solid analytical capabilities and interest in algorithms.

Preferred Skills

• Object-oriented programming and design experience.
• Python proficiency including Data Structures, Collections, Pandas, and frameworks like Django or Flask.
• Knowledge of Kerberos for data security and Tableau for visual analytics.

Key Skills

Education

Bachelor's degree