Description

You will own the quality assurance strategy for migrating infrastructure and data pipelines across cloud providers. You design and execute test plans to ensure data integrity in distributed streaming environments.

Responsibilities

• Develop and perform validation tests for Kafka and Spark Streaming platforms to guarantee data accuracy.
• Conduct performance, load, stress, and failover testing in cloud and containerized environments.
• Implement automated end-to-end and integration tests using Python and Go.
• Manage infrastructure validation using Docker, Kubernetes, and Terraform.
• Collaborate with DevOps teams to integrate monitoring tools and troubleshoot migration issues.

Required Skills

• 5+ years of experience with cloud platforms (GCP, Azure, or AWS).
• Hands-on expertise with streaming technologies, specifically Kafka and Spark Streaming.
• Proficiency in Infrastructure as Code tools: Terraform, Open Tofu, or Liquibase.
• Strong experience with containerization and orchestration: Docker and Kubernetes.
• Advanced programming skills in Python and Go.
• Experience working in Linux environments.
• Understanding of data streaming concepts and data pipeline migration.

Key Skills

Education

Any Graduate