Description

You will own the quality assurance strategy for migrating infrastructure and data pipelines across cloud providers.

This role is remote.

Responsibilities

• Design and execute test plans to ensure data integrity in distributed streaming environments.
• Develop and perform validation tests for Kafka and Spark Streaming platforms to guarantee data accuracy.
• Implement automated end-to-end and integration tests using Python and Go.
• Conduct performance, load, stress, and failover testing in cloud and containerized environments.
• Manage infrastructure validation using Docker, Kubernetes, and Terraform.

Required Skills

• 5+ years of experience with cloud platforms (GCP, Azure, or AWS).
• Hands-on expertise with streaming technologies, specifically Kafka and Spark Streaming.
• Proficiency in Infrastructure as Code tools: Terraform, Open Tofu, or Liquibase.
• Strong experience with containerization and orchestration: Docker and Kubernetes.
• Advanced programming skills in Python and Go.
• Experience working in Linux environments.
• Understanding of data streaming concepts and data pipeline migration.

Key Skills

Education

Any Graduate