Design and execute comprehensive test plans to ensure seamless migration of infrastructure and data pipelines across cloud providers.
Develop and perform validation tests for distributed streaming platforms such as Kafka and Spark Streaming, ensuring data accuracy and integrity.
Conduct performance, load, stress, and failover testing to simulate high-volume data conditions in cloud and containerized environments.
Implement and maintain automated end-to-end and integration tests using Python and Go, leveraging Docker, Kubernetes, and Terraform for infrastructure validation.
Collaborate with DevOps teams to integrate monitoring tools, troubleshoot issues, and ensure system reliability during migration processes.
What's Needed?
At least 3 years of experience working with cloud platforms such as GCP, Azure, or AWS, and modern pipelining technologies.
Hands-on expertise with streaming technologies like Kafka, Spark Streaming, and understanding of data streaming concepts.
Proficiency with Infrastructure as Code (IaC) tools such as Terraform, Open Tofu, or Liquibase.
Experience with containerization and orchestration tools including Docker and Kubernetes.
Strong programming and scripting skills in Python and Go, with experience working in Linux environments