Description

Build and maintain data processing applications within a Hadoop ecosystem.

Responsibilities

• Write custom ETL applications using Spark following standard architecture.
• Perform functional, end-to-end, performance, and UAT testing on your own code and peer contributions.
• Conduct thorough code reviews and maintain clear communication with the team.
• Document test cases used during the QA process.
• Deliver code that meets all requirements, acceptance criteria, and documentation standards.

Required Skills

• 14+ years of professional experience.
• Hands-on experience with Spark, Hadoop, HDFS, MapReduce, YARN, HBase, Hive, Pig, Flume, and Java.
• Proficiency with ETL tools such as Talend, Kettle, Informatica, or AbInitio.
• Experience with Hadoop or NoSQL performance optimization and benchmarking using HiBench or YCSB.
• Experience using performance monitoring tools like Ganglia, Nagios, Splunk, or DynaTrace.
• Experience with continuous build and test processes using Maven and Jenkins.
• Bachelor's degree or equivalent graduate qualification.

Preferred Skills

• Hortonworks or Cloudera certification.

Key Skills

Education

Any Graduate