RTS - Real Time Streaming - Data Engineer

You will design and develop large-scale real-time streaming architectures and distributed systems.

Responsibilities

• Design and implement event-driven architectures using streaming data sets at scale.
• Develop and maintain automated build and deployment pipelines using CI/CD principles.
• Troubleshoot and resolve issues within distributed services ecosystems and production environments.
• Ensure data security by implementing encryption, anonymization, and strict logging policies for sensitive data.
• Research and benchmark technologies to ensure high-quality technical and application architecture.

Required Skills

• 5+ years of development and design experience in Java, Scala, or Python.
• Hands-on experience with Flink, Beam, or Spark Streaming (real-time data, not batch).
• Deep knowledge of Kafka and Kafka Streams.
• Proficiency with containerization and orchestration using Docker and OpenShift or Kubernetes.
• Experience with GitOps and automated deployment tools like Jenkins, ArgoCD, Kaniko, or Shipwright.
• Practical experience with Azure or OCI public cloud environments.
• Strong understanding of distributed systems, network fundamentals, and host-level routing.
• Competency in Linux OS configuration and shell scripting.
• Experience with automated unit and integration testing.
• Working knowledge of Agile methodology.

Preferred Skills

• Experience with Azure automation toolsets.