Description

You will design and manage large-scale data processing workflows within a Hadoop ecosystem.

Responsibilities

• Build and maintain data pipelines using Spark and Hive.
• Manage data ingestion and movement using Sqoop and Kafka.
• Develop automation scripts using Python and Shell.
• Write and optimize complex SQL queries for data analysis.
• Collaborate with teams to integrate solutions into client environments.

Required Skills

• 5+ years of experience in Big Data engineering.
• Strong proficiency in SQL is mandatory.
• Hands-on experience with Spark and Python.
• Deep understanding of Hadoop Architecture and HDFS.
• Experience with Hive and Sqoop.
• Proficiency in Shell scripting.
• Working knowledge of Kafka.

Preferred Skills

• Experience with Presto.

Key Skills

Education

Any Graduate