Description

·    Lead the technical migration of self-managed/on-premises Kafka clusters to AWS MSK, including cluster sizing, topic replication, and cutover planning.
·    Design and implement Java-based microservices and REST APIs that produce to and consume from Kafka topics.
·    Develop full-stack features, including backend services and UI integration where applicable, to support event-driven architectures.
·    Re-architect or refactor existing producer and consumer applications for MSK compatibility, including IAM authentication, TLS, VPC connectivity, and security groups.
·    Implement monitoring, alerting, and observability for MSK using Amazon CloudWatch, Prometheus/Grafana, or equivalent tools.
·    Define and execute data validation, dual-write/dual-read, and rollback strategies during migration cutover.
·    Optimize Kafka topic partitioning, replication factor, retention policies, and consumer group configurations for AWS MSK.
·    Collaborate with DevOps and Infrastructure teams on Terraform- or CloudFormation-based provisioning of MSK clusters.
·    Ensure compliance with security, encryption at rest and in transit, and access control standards using IAM, SASL/SCRAM, and mTLS.
·    Troubleshoot performance, latency, and throughput issues before and after migration.
·    Document migration runbooks, architecture decisions, and operational procedures.
·    Mentor junior engineers on Kafka and AWS MSK best practices.

Basic Qualifications: (skills required for this job)
·    5+ years of relevant software engineering experience; experience range is flexible based on demonstrated expertise.
·    5+ years of  Strong hands-on experience with Java 8, 11, or 17; Spring Boot; and REST API development.
·    5+ years of  Deep expertise in Apache Kafka producers and consumers, Kafka Streams, Kafka Connect, schema registry using Avro or Protobuf, partition strategy, and consumer group management.
·    5+ years of Proven experience provisioning, configuring, and migrating workloads to AWS MSK, with familiarity with MSK Connect and MSK Serverless.
·    5+ years of  Hands-on experience with AWS services including IAM, VPC, CloudWatch, Lambda, S3, and Secrets Manager.
·    5+ years of  Frontend framework exposure, such as React or Angular, for full-stack ownership.
·    5+ years of  Experience with CI/CD tools such as Jenkins or GitLab CI; Infrastructure as Code using Terraform or CloudFormation; and Docker/Kubernetes.
·    5+ years of  Experience with SQL and NoSQL databases, including PostgreSQL, DynamoDB, and MongoDB.
·    5+ years of  Experience with large-scale, mission-critical migrations in regulated environments; financial services experience is preferred.
·    Strong understanding of distributed systems, fault tolerance, and event-driven design patterns.
·    Strong stakeholder communication skills for cross-functional migration coordination.
·    Ability to work independently in ambiguous and evolving technical environments.
·    Problem-solving mindset with a focus on zero-downtime migration strategies

Key Skills

Education

Bachelor's degree