You will build and maintain large-scale streaming solutions and high-volume data processing systems.
Responsibilities
- Develop large-scale streaming solutions using Kafka and Cassandra.
- Build multi-threaded applications utilizing parallel processing and concurrency concepts.
- Manage high-volume batch and streaming data processing with Spark.
- Perform system performance tuning and testing.
- Write technical documentation including system admin guides, installation guides, and troubleshooting guides.
Required Skills
- 5+ years of experience in software development.
- Strong proficiency in Java and C/C++.
- Hands-on experience with SpringBoot.
- Deep expertise in Kafka and Cassandra for streaming solutions.
- Experience with Spark for data processing.
- Proficiency in Linux environments and Shell scripting.
- Experience with automation tools including Gradle, Concourse, and Ansible.
- Knowledge of messaging technologies such as JSON and REST.
- Experience with observability stacks: ELK (Elasticsearch, Logstash, Kibana) and monitoring tools (Telegraf, Prometheus, Grafana, Alertmanager).
Preferred Skills
- Experience with Python, Scala, or AngularJS.
- Knowledge of Kubernetes, Docker, and AWS deployment.
- Experience with relational databases like MySQL or NoSQL like MongoDB.