Description
You will lead the development of data solutions and manage machine learning workflows within a GCP environment.
Responsibilities
- Design, build, and maintain scalable data pipelines for ingestion, transformation, and integration using Kafka and Databricks.
- Develop and manage feature engineering pipelines for machine learning workflows using Vertex AI and BigQuery ML.
- Implement automated unit, integration, and performance testing frameworks to ensure data quality and reliability.
- Modernize core data assets across SQL, NoSQL, cloud-based, and real-time streaming platforms.
- Draft architectural diagrams and technical documentation while providing cost/benefit analyses for architectural decisions.
Required Skills
- 7+ years of professional project experience.
- Expertise in Google Cloud Platform (GCP) and Vertex AI.
- Strong proficiency in Python and custom library development.
- Experience with Kafka and Databricks.
- Hands-on experience with BigQuery ML and advanced feature engineering.
- Ability to work independently alongside data science teams.
- Strong technical communication skills.
- Degree in any graduate field.