Description

You design and implement data engineering solutions within the Google Cloud Platform environment, focusing on streaming architectures and AI integration.

Responsibilities

• Design and implement data pipelines using GCP services.
• Develop and maintain data processing workflows, including real-time streaming architectures.
• Implement AI agents or LLM-based automation systems.
• Manage and optimize data storage and processing within Cloud Storage and BigQuery.

Required Skills

• 6+ years of professional experience in Data Engineering.
• Strong proficiency in Python and SQL.
• Hands-on experience with Google Cloud Platform (GCP).
• Expertise with BigQuery, Dataflow (Apache Beam), Pub/Sub, and Cloud Composer/Airflow.
• Experience building real-time and streaming data architectures.
• Familiarity with Vertex AI, LLM integration, embeddings, and vector search.

Preferred Skills

• Experience designing AI agents or LLM-based automation systems.

Key Skills

Education

Bachelor's degree