Description

Design, develop, and operate high-scale data applications with a focus on scalability and security.

This role is on-site.

Responsibilities

• Design and develop data pipelines and processing systems using Hadoop, Spark, MapReduce, and Hive.
• Build ETL processes and data pipelines using Informatica and RDBMS like Oracle, SQL Server, and Snowflake.
• Automate routine jobs and end-to-end workflows using Python and Unix shell scripting.
• Manage the full SDLC, from requirement gathering and technical design to testing and support operations.
• Deploy updates, bug fixes, and software components through CI/CD pipelines.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Spark, MapReduce, and Hive.
• Experience with RDBMS including Oracle, SQL Server, and Snowflake.
• Strong Python and Unix shell scripting skills for automation.
• Hands-on experience with CI/CD pipelines.
• Solid understanding of the full SDLC.
• Bachelor's degree in Computer Science, Engineering, IT, or a related field.

Preferred Skills

• Experience with Informatica for ETL processes.

Key Skills

Education

Any Graduate