Description

You will support, monitor, and maintain microservices-based data platforms in production, ensuring high availability and performance of Kafka-based ingestion and processing pipelines.

This role is on-site.

Responsibilities

• Proactively monitor, troubleshoot, and resolve incidents across distributed systems and streaming platforms.
• Own operational readiness for non-production and production environments, including start/stop procedures, dependency validation, and release support.
• Drive automation initiatives for deployments, vulnerability remediation, monitoring, alerting, and operational recovery workflows.
• Handle production incidents (P1/P2), including Root Cause Analysis (RCA) preparation and support runbook execution.
• Manage Kafka topic inventory, metadata mapping, consumer group operations, and backlog monitoring.

Required Skills

• Strong programming expertise in Java and/or Python.
• Hands-on experience with Apache Kafka, including topics, partitions, brokers, consumer groups, Kafka Connect, and lag monitoring.
• Proven experience in microservices architecture, including building, supporting, and troubleshooting.
• Solid understanding of SRE principles: SLAs, SLOs, incident response, threshold-based alerting, observability, and system resilience.
• Experience with CI/CD pipelines (Jenkins, GitLab CI/CD, Nexus) and Git-based source control.
• Strong troubleshooting capability across logs, metrics, traces, infrastructure dependencies, and application failures.
• Knowledge of data ingestion mechanisms (Kafka, SFTP, APIs) and formats (JSON, Parquet).
• Experience with cloud platforms (AWS or Azure), Docker, and Kubernetes (AKS preferred).
• Familiarity with observability tools: Grafana, Prometheus, Pushgateway, Splunk.

Preferred Skills

• Exposure to Cloudera-managed Kafka environments.

Key Skills

Education

Bachelor's degree