Description

You will build and maintain large-scale data processing systems and pipelines.

Responsibilities

• Develop and optimize data processing tasks using Spark and Scala.
• Manage data workloads within Hadoop Cloudera distributions.
• Build and maintain CI/CD pipelines for data workflows.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Write and maintain Unix Shell scripts for automation and data tasks.

Required Skills

• 4+ years of experience in data engineering.
• Hands-on experience with Hadoop Cloudera distribution.
• Proficiency in Spark and Scala.
• Experience with Big Data technologies.
• Experience with Docker and Kubernetes platforms.
• Experience with Oracle or other relational databases.
• Strong Unix Shell scripting skills.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with Oozie scheduler or other workflow schedulers.
• Experience managing Elasticsearch clusters.
• Quantexa Academy certification or previous Quantexa project experience.

Key Skills

Education

Bachelor's degree in Computer Science