Description

You will build and maintain data pipelines specifically designed to support AI and machine learning workflows.

Responsibilities

• Design, build, and maintain data pipelines using Apache Spark and Python.
• Develop and manage workflow orchestration via Apache Airflow.
• Implement scalable data solutions on Google Cloud Platform using BigQuery, Cloud Storage, Dataflow, and Vertex AI.
• Collaborate with data scientists to embed machine learning models into production-grade pipelines.
• Monitor, troubleshoot, and optimize data workflows and ML model performance.

Required Skills

• 7+ years of experience in Data Engineering and AI/ML.
• Proficiency with Apache Spark.
• Strong programming skills in Python and Java.
• Hands-on experience with Google Cloud Platform (GCP).
• Experience using BigQuery and Dataflow.
• Experience with Apache Airflow for orchestration.
• Experience with Vertex AI for machine learning workflows.
• Knowledge of version control, testing, and deployment best practices.
• Degree in any graduate field.

Key Skills

Education

Any Gradute