Description

Responsibilities

• Lead the migration of on-premises or self-managed Kafka clusters to AWS MSK, including planning, sizing, replication, and production cutovers.
• Design, develop, and maintain Java/Spring Boot microservices and REST APIs that publish and consume Kafka events.
• Build and enhance full-stack applications using modern frontend technologies (React or Angular) where required.
• Refactor Kafka producers and consumers to support AWS MSK, including IAM authentication, TLS, networking, and security best practices.
• Optimize Kafka performance through effective partitioning, replication, retention, and consumer group management.
• Implement monitoring and observability using CloudWatch, Prometheus, Grafana, or similar tools.
• Develop migration strategies including validation, dual-read/dual-write, rollback planning, and production readiness.
• Partner with DevOps teams to provision infrastructure using Terraform or CloudFormation.
• Ensure secure, compliant implementations with encryption, IAM, mTLS, and SASL/SCRAM authentication.
• Troubleshoot application, streaming, and infrastructure performance issues.
• Produce technical documentation, migration runbooks, and operational procedures.
• Mentor junior engineers and promote Kafka and AWS best practices.

Required Qualifications

• 5+ years of software engineering experience with Java-based enterprise applications.
• Strong expertise in Java (8/11/17), Spring Boot, and RESTful API development.
• Deep experience with Apache Kafka, including:
  • Producers and consumers
  • Kafka Streams
  • Kafka Connect
  • Schema Registry (Avro or Protobuf)
  • Consumer groups and partitioning strategies
• Proven experience implementing or migrating workloads to AWS MSK (including MSK Connect or MSK Serverless).
• Hands-on experience with AWS services including IAM, VPC, CloudWatch, Lambda, S3, and Secrets Manager.
• Experience building full-stack applications using React or Angular.
• Experience with CI/CD pipelines (Jenkins or GitLab CI), Infrastructure as Code (Terraform or CloudFormation), and container technologies such as Docker and Kubernetes.
• Experience working with SQL and NoSQL databases including PostgreSQL, DynamoDB, or MongoDB.
• Strong understanding of distributed systems, event-driven architectures, scalability, and fault tolerance.
• Experience supporting large-scale production migrations with minimal downtime.
• Excellent communication skills and the ability to collaborate across engineering and infrastructure teams.
• Strong analytical and problem-solving skills with the ability to work independently in fast-paced environments.

Preferred Qualifications

• Experience migrating from self-managed or Confluent Kafka environments to AWS MSK.
• Financial services or other highly regulated industry experience.
• AWS certifications (Solutions Architect, Developer Associate, or similar).
• Experience implementing Kafka security using IAM, mTLS, SASL/SCRAM, and encryption best practices

Key Skills

Education

Bachelor's degree