Description

You will implement and operationalize modern AI-enabled data capabilities on Google Cloud to ingest, transform, and distribute data for big data applications.

This role is on-site.

Responsibilities

• Leverage AI and agentic frameworks to automate data management, governance, and consumption capabilities including pipelines, quality, and compliance.
• Collaborate with principal engineers, product managers, and data engineers to roadmap and deliver key data capabilities based on priority.
• Consult on complex, large-scale initiatives and review long-term specialty software engineering challenges.
• Develop and maintain data flows using streaming technologies and batch processing.
• Apply context and prompt engineering to auto-generate data engineering code.

Required Skills

• 5+ years of Specialty Software Engineering experience or equivalent.
• 5+ years of data engineering experience with cloud solutions, specifically creating and supporting Spark-based ingestion and processing.
• 3+ years of hands-on experience with Data lakehouse architecture and design.
• Proficiency in Python, PySpark, Kafka, Airflow, Google Cloud Storage, BigQuery, Data Proc, and Cloud Composer.
• Recent demonstrable skills using AI tools such as LangChain, LangGraph/ADK, agentic frameworks, RAG, GraphRAG, and MCP to build agent-based data capabilities.
• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming.

Preferred Skills

• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics.
• Experience with Web-based UI development using React and Node JS.

Key Skills

Education

Bachelor's degree