Description

You will lead the design and implementation of data integration pipelines within a Cloudera Hadoop environment.

Responsibilities

• Translate business requirements from data analysts into technical specifications.
• Build and maintain data integration pipelines using the Cloudera Hadoop platform.
• Transform raw data into consumable layers for diverse application use cases.
• Manage pipeline maintenance through bug fixes and feature enhancements.
• Optimize application performance and tune configuration parameters for efficiency.

Required Skills

• 5+ years of professional software development experience.
• Expertise in Java, Spring, and Microservices architecture.
• Proficiency in Hadoop ecosystem tools including MapReduce, Hive, Sqoop, Oozie, and Impala.
• Strong Spark development skills using Scala or Python.
• Advanced SQL skills and experience with query tuning.
• Extensive UI development experience with Angular.
• Hands-on experience with NoSQL stores, specifically HBase, Cassandra, or MongoDB.
• Proven ability to develop CI/CD pipelines within a DevOps environment.
• Deep understanding of Agile or Scrum methodologies.

Preferred Skills

• Advanced experience specifically with HBase.

Key Skills

Education

Any Graduate