Build and manage high-throughput, real-time streaming pipelines for critical transformation projects.
Responsibilities
- Develop Flink data processing applications to handle high-throughput streaming data.
- Design and implement scalable applications that read from various sources and write to multiple sinks.
- Provide architectural solutions and technical guidance to the Flink development team.
- Integrate Flink with technologies such as Kafka and MongoDB.
- Collaborate with the team to design, test, and refine deliverables within the SDLC.
Required Skills
- 10+ years of Java development experience with expertise in data transformation.
- 5+ years of experience consuming streaming data using Kafka and Flink.
- 5+ years of experience building high-throughput pipelines with Flink.
- Hands-on experience with Continuous Integration and Deployment (CI/CD).
- Experience with large-scale enterprise integrations and customer-facing applications.
- Knowledge of messaging and data processing on cloud platforms like AWS, Azure, or GCP.
- Bachelor's degree.
Preferred Skills
- Experience with Apache Flink Stream, Batch, and Table APIs.
- Experience with Apache Spark (Structured streaming, Batch processing).