← Back to jobs

U3 Infotech Pte Ltd Logo
Big Data Platform Engineer/Architect
Posted On: 1 day ago
Experience: 5+ years
Availability: Hybrid
Openings: 1
Category: BigData Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Define the architecture and strategy for batch workloads in hybrid cloud environments, managing Kubernetes clusters and building automated platform tools.

This role is on-site.

Responsibilities

  • Design and develop batch data processing pipelines for on-premise and public cloud environments.
  • Manage the lifecycle of Kubernetes clusters to support batch processing workloads.
  • Build automated tools for the build, test, deployment, and management of the platform.
  • Implement multi-tenancy, capacity planning, and security segregation for Lab and BAU workloads.
  • Monitor system events to maintain health, availability, and service quality.

Required Skills

  • 8+ years of experience with Big Data technologies including Spark, Hive, and Presto.
  • 2+ years of experience with Kubernetes or OpenShift.
  • Proficiency in Java, Bash, or Python.
  • Experience with Git and Bitbucket for source control.
  • Hands-on experience with Jenkins for CI/CD pipelines.
  • Experience with Ansible and Terraform for configuration management.
  • In-depth knowledge of Linux environments, specifically RHEL.
  • Strong understanding of distributed systems, OOP, data structures, and algorithms.
  • Experience designing and implementing RESTful APIs.

Preferred Skills

  • Experience with the Go programming language.
  • Hands-on experience with Docker.
  • Experience running Kubernetes in a production environment.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs