Description

You will design and optimize large-scale data processing workflows within a distributed environment.

Responsibilities

• Build and maintain ETL pipelines for structured and semi-structured data.
• Develop and tune efficient HiveQL queries to ensure high performance.
• Manage data stored in HDFS and utilize the Hadoop ecosystem for processing.
• Collaborate with analysts and engineers to deliver scalable data solutions.
• Maintain data quality, integrity, and security throughout the data lifecycle.

Required Skills

• 5+ years of experience in big data engineering.
• Hadoop and HDFS.
• Hive and HiveQL.
• Spark.
• MapReduce.
• Sqoop and Oozie.
• Python.
• Shell scripting.
• ETL and Data Warehousing.

Key Skills

Education

Any Gradute