Description

You will build and maintain Big Data pipelines and provide production support for Hadoop-based systems.

This role is on-site.

Responsibilities

• Build data pipelines using Hadoop components including Sqoop, Hive, Solr, MapReduce, Impala, Spark, and Spark SQL.
• Develop Hive QL and UDFs to analyze structured and semi-structured datasets.
• Ingest and process various file formats such as Avro, Parquet, Sequence Files, and Text Files.
• Write automation scripts in Java, Bash, or Python to streamline jobs and resolve production issues.
• Manage data retrieval and relational database design using SQL.

Required Skills

• 5+ years of programming experience in Java, Scala, or Python.
• Hands-on experience with Cloudera Distribution 6.x.
• Experience creating and indexing Solr collections in a Solr Cloud environment.
• Proficiency in SQL and relational database design.
• Knowledge of NoSQL systems such as HBase or Cassandra.
• Experience with Spring framework, Web Services, and REST APIs.
• Expertise in Unix/Linux environments, including script writing and job scheduling.
• Experience with real-time analytics tools like Spark, Kafka, or Storm.
• Familiarity with Agile development methodologies.

Preferred Skills

• Project experience in Query Processing Language (QPL).

Key Skills

Education

Any Graduate