Description

You build and maintain data pipelines and automation scripts within a Hadoop ecosystem.

Responsibilities

• Write complex MySQL and Hive queries to manage and extract data.
• Develop Python scripts to automate business processes.
• Build and manage ETL pipelines to ensure data integrity.
• Perform data analysis and reporting using Excel and CSV formats.
• Operate within Agile, SDLC, and CI/CD frameworks.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in MySQL and Hive query writing.
• Strong understanding of the Hadoop ecosystem, including MapReduce and Hive.
• Experience programming in Python for automation.
• Working knowledge of Java and Scala.
• Hands-on experience with ETL pipeline development.
• Familiarity with Agile methodologies and CI/CD practices.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree