Description

Design, build, and deploy production-level data pipelines within the Google Cloud ecosystem. You will own the development of reusable Flex templates and processing frameworks.

Responsibilities

• Develop reusable Flex templates and data processing frameworks using Java for batch and stream processing.
• Design and implement Event Driven Architectures to handle real-time streaming of database changes and events.
• Build and manage data pipelines using Kafka and Kafka Connect with connector types including HTTP REST proxy, JMS, File, SFTP, and JDBC.
• Operate and maintain data workflows across Google Cloud Platform services.

Required Skills

• 6-8 years of experience as a Java Apache Beam Developer.
• Strong proficiency in Java and Google Cloud Platform (GCP).
• Hands-on experience with DataFlow (Apache Beam), BigQuery, and Apigee.
• Deep knowledge of Pub/Sub, Kafka, and Confluent Kafka for real-time streaming.
• Experience with Google Cloud SQL, BigTable, Cloud Storage, and Compute Engine.
• Practical experience with Cloud Functions, Cloud Run, and App Engine.
• Knowledge of the Apache Hadoop family of distributed storage and processing utilities.

Preferred Skills

• Experience implementing Event Driven Architecture.

Key Skills

Education

Any Graduate