Description

You will design, build, and maintain large-scale real-time analytics infrastructure and streaming data pipelines on Google Cloud Platform.

Responsibilities

• Design and maintain large-scale streaming data pipelines using Apache Beam, Kafka, Kinesis, Pub/Sub, and Dataflow.
• Develop and implement streaming data processing jobs using Java.
• Integrate streaming pipelines with existing data warehouses and data lakes.
• Monitor and troubleshoot pipelines to ensure high availability and performance.
• Implement DevOps principles for efficient deployment of processing systems.

Required Skills

• 7+ years of software engineering experience focused on streaming data pipelines and analytics.
• Strong programming proficiency in Java.
• Google Cloud Platform (GCP) certification is required.
• Hands-on experience with Apache Beam.
• Practical experience with Apache Kafka and Apache Kinesis.
• Proficiency with Docker and Kubernetes.
• Experience with AWS and Microsoft Azure.

Preferred Skills

• Experience with machine learning and data science technologies.

Key Skills

Education

Bachelor's Degree