Description

You will design and implement large-scale data processing solutions using the Hadoop ecosystem.

Responsibilities

• Develop batch and real-time streaming data pipelines.
• Build processing logic using Spark for batch and streaming workloads.
• Manage data orchestration using Oozie and Airflow schedulers.
• Implement CI/CD workflows for data engineering deployments.
• Maintain data storage and query layers using Hive, Impala, Ozone, and Iceberg.

Required Skills

• 6+ years of experience in the Hadoop Big Data ecosystem.
• Expertise in Spark using Python or Scala.
• Hands-on experience with Apache Kafka.
• Practical experience with GCP cloud environments.
• Proficiency in SQL and Python or Shell scripting.
• Experience with Cloudera ecosystem tools.
• Working knowledge of Hadoop fundamental concepts.
• Experience with Hive, Impala, Ozone, and Iceberg.
• Degree in any field of study.

Key Skills

Education

Any graduate