Description

You will design and build complex data pipelines and ETL processes using Big Data technologies.

This role is remote.

Responsibilities

• Develop data pipelines and ETL workflows to load data from multiple sources into HDFS.
• Convert complex queries to Hive and create scripts for structured data processing.
• Design object models, process flows, sequence diagrams, and data flow architectures.
• Implement software using Test Driven Development (TDD) and Behavior Driven Development (BDD).
• Perform code reviews, mentor junior team members, and provide production support.

Required Skills

• 10+ years of software development experience.
• Extensive experience with Hadoop, Hive, Sqoop, Oozie, and HDFS.
• Proficiency with Oracle, Teradata, and SQL Server.
• Experience with Informatica and Ab Initio.
• Strong command of Unix and Shell Scripting.
• Solid understanding of SDLC and Agile methodologies.

Preferred Skills

• Ability to design software using modern frameworks and tools.

Key Skills

Education

Any Graduate