Description

You will design and maintain large-scale data infrastructure, managing processing tasks and automating release pipelines.

This role is on-site.

Responsibilities

• Design and develop data infrastructure using Hadoop, Spark, HDFS, Hive, and Ranger.
• Deploy and orchestrate workloads using OpenShift (OCP) and Kubernetes.
• Automate infrastructure and release processes using CI/CD pipelines and DevOps practices.
• Troubleshoot technical challenges and resolve complex data engineering issues.

Required Skills

• 10+ years of experience in data engineering.
• Expertise in Hadoop, Spark, HDFS, Hive, and Ranger.
• Proficiency in Python, Scala, Java, or Spark programming.
• Experience with containerization using Docker and OpenShift.
• Experience with Kubernetes orchestration.
• Hands-on with DevOps tools including Jenkins, Ansible, and BitBucket.
• Bachelor's degree in Computer Science, Data Engineering, IT, or a related field.

Preferred Skills

• Experience with monitoring tools like Grafana, Prometheus, and Splunk.
• Experience with cloud platforms such as AWS, Azure, or GCP and their data services.

Key Skills

Education

Bachelor's Degree