Description

Build and maintain scalable data pipelines and processing systems.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using Hadoop, Spark, and Hive.
• Manage ETL processes and data movement with Informatica, Oracle, and SQL Server.
• Automate routine tasks using Python and Unix shell scripting.
• Deploy updates and bug fixes through CI/CD pipelines in an agile environment.
• Support the full SDLC, from requirement gathering to testing and operations.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Hadoop, Spark, and Hive.
• Experience managing ETL processes.
• Hands-on work with Oracle and SQL Server.
• Strong Python and Unix shell scripting skills.
• Experience with CI/CD pipelines.
• Understanding of the SDLC and agile development practices.
• Ability to perform unit, functional, and integration testing.

Preferred Skills

• Any Graduate

Key Skills

Education

Any Graduate