Description

You will own the design, development, and maintenance of data engineering solutions.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools.
• Implement batch and real-time data ingestion from diverse sources, optimizing workflows for performance and reliability.
• Build, deploy, and manage data engineering workloads on Red Hat OpenShift, maintaining necessary manifests and templates.
• Implement infrastructure-as-code using tools like Terraform and Ansible within hybrid/multi-cloud environments.
• Develop CI/CD pipelines for data services, automating testing and deployment processes.

Required Skills

• Bachelor's degree in Computer Science, Data Engineering, or related field.
• 8+ years of experience as a Data Engineer or Platform Engineer.
• Strong experience deploying applications on OpenShift/Kubernetes.
• Proficiency with Python and SQL.
• Expertise with big data technologies including Spark, Kafka, and Hive.
• Deep understanding of containers (Docker/Podman) and microservices architecture.
• Experience with CI/CD, Git, and automation tooling.
• Familiarity with cloud platforms such as AWS and Azure.
• Experience with monitoring stacks like Prometheus, Grafana, and EFK Stack.

Key Skills

Education

Bachelor's degree