Description

You will build and maintain data workflows and sanitization processes within a Hadoop ecosystem.

This role is on-site.

Responsibilities

  • Translate business requirements into technical data workflows.
  • Build workflow configurations and execute data sanitization validations for multiple lines of business.
  • Perform file extraction and data access processes, including row and column level file-splits.
  • Monitor Hadoop clusters and provide regular progress updates to the leadership team.

Required Skills

  • 6+ years of IT experience.
  • Hands-on experience with Hadoop architecture, Hive, and HDFS (AVRO, Parquet, QRC formats).
  • Working knowledge of MapReduce and Spark concepts.
  • Strong UNIX programming and scripting skills.
  • Experience with ETL processes using DataStage, Informatica, or Teradata+Unix.
  • Exposure to scheduling and automation using AutoSys.
  • Proficiency with data connection methods via JDBC and ODBC.
  • Database management experience with RDBMS such as DB2, SQL, Oracle, Netezza, Sybase, Siebel, Teradata, or MySQL.

Key Skills
Education

Any Graduate

Back To Jobs