Description

You will design, develop, and operate high-scale data applications with a focus on security and scalability.

Responsibilities

• Design and develop data pipelines and processing systems using Hadoop, Spark, MapReduce, and Hive.
• Build ETL processes and data pipelines using Informatica and RDBMS technologies.
• Create end-to-end automation for routine jobs using Python and Unix shell scripting.
• Manage the full software development life cycle, from requirement gathering and technical design to testing and support.
• Deploy updates and bug fixes through CI/CD pipelines and execute unit, functional, and integration tests.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Spark, MapReduce, and Hive.
• Experience with RDBMS including Oracle, SQL Server, and Snowflake.
• Strong Python and Unix shell scripting skills for automation.
• Solid understanding of the SDLC and agile development practices.
• Experience designing and maintaining data pipelines and ETL processes.
• Ability to document technical specifications and application functionality.
• Bachelor's degree in Computer Science, Engineering, IT, or a related field.

Key Skills

Education

Any Graduate