Description

Job Description:

We are seeking a highly experienced Senior Kafka Solution Architect with strong hands-on expertise in Apache Kafka and Confluent Kafka and a solid background in Microsoft .NET technologies.

The ideal candidate will have extensive experience designing, architecting, implementing, and managing enterprise-grade event-driven architectures and real-time streaming solutions using Apache Kafka and the Confluent Platform. Candidates must have prior hands-on development experience with .NET / C#, along with the ability to integrate Kafka-based messaging and streaming solutions into .NET applications and enterprise systems.

The candidate will be responsible for defining end-to-end Kafka architecture, designing scalable and highly available distributed messaging solutions, establishing architectural standards, and providing technical leadership to development teams.

Key Responsibilities:

• Design and implement enterprise-grade solutions using Apache Kafka and Confluent Kafka.
• Define end-to-end Kafka architecture, including event-driven architecture, messaging, and real-time data streaming.
• Provide hands-on technical leadership for Kafka implementation, configuration, deployment, and optimization.
• Design and develop Kafka producers, consumers, topics, partitions, and consumer groups.
• Integrate Kafka messaging and streaming capabilities with .NET / C# applications and microservices.
• Leverage Confluent Platform components, including Schema Registry, Kafka Connect, and Kafka Streams.
• Design event-driven microservices architecture using Kafka and .NET technologies.
• Implement secure, scalable, fault-tolerant, and highly available Kafka clusters.
• Define messaging standards, event schemas, serialization, and data governance practices.
• Optimize Kafka performance, throughput, latency, and resource utilization.
• Implement Kafka security using SSL/TLS, SASL, ACLs, and authentication mechanisms.
• Collaborate with application development, cloud, DevOps, and enterprise architecture teams.
• Troubleshoot complex Kafka integration, messaging, and distributed system issues.

Required Technical Skills:

• Strong hands-on experience with Apache Kafka architecture and implementation.
• Extensive experience with Confluent Kafka / Confluent Platform.
• Strong professional background in Microsoft .NET / .NET Core / .NET 6+ and C#.
• Experience integrating Apache Kafka with .NET applications and microservices.
• Strong knowledge of Kafka Producers, Consumers, Topics, Partitions, and Consumer Groups.
• Hands-on experience with Confluent Schema Registry, Kafka Connect, and Kafka Streams.
• Strong understanding of Event-Driven Architecture (EDA), Microservices, and Distributed Systems.
• Experience with REST APIs, messaging patterns, and asynchronous communication.
• Knowledge of Avro, JSON, Protobuf, and event serialization formats.
• Experience with Kafka cluster management, monitoring, performance tuning, and troubleshooting.
• Understanding of Kafka security, fault tolerance, replication, and disaster recovery.

Preferred Skills:

• Experience with AWS, Azure, or other cloud platforms.
• Experience with Docker and Kubernetes.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with Redis, SQL Server, PostgreSQL, or other enterprise databases.
• Experience designing large-scale enterprise integration solutions.
• Strong communication, stakeholder management, and technical leadership skills

Key Skills

Education

Any Graduate