Description

Build, maintain, and optimize scalable data pipelines and machine learning workflows on Google Cloud Platform.

This role is on-site.

Responsibilities

• Design and build robust data pipelines using Apache Spark and Python.
• Manage workflow orchestration and scheduling with Apache Airflow.
• Implement scalable data solutions on GCP, leveraging BigQuery, Cloud Storage, Dataflow, and Vertex AI.
• Collaborate with data scientists to embed machine learning models into production-grade pipelines.
• Monitor, troubleshoot, and optimize data workflows and ML model performance for reliability and scalability.

Required Skills

• 7+ years of experience in data engineering.
• Strong proficiency in Python and Apache Spark.
• Hands-on experience with Google Cloud Platform services, specifically BigQuery, Dataflow, and Cloud Storage.
• Experience with Apache Airflow for workflow orchestration.
• Knowledge of Vertex AI for ML model integration.
• Understanding of version control, testing, and deployment best practices.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Experience maintaining documentation for data systems.
• Proven track record of optimizing high-performance data systems.

Key Skills

Education

Bachelor's degree