Description

You will build and manage the data infrastructure required for Generative AI model training and inference.

Responsibilities

• Design and implement data pipelines for ingesting, pre-processing, and transforming large-scale datasets.
• Build and maintain data storage solutions, including data lakes, warehouses, and databases.
• Implement data security and governance policies to protect sensitive data used in Generative AI projects.
• Collaborate with data scientists and engineers to translate model requirements into efficient pipelines.
• Monitor and optimize pipelines for performance, scalability, and cost-effectiveness.

Required Skills

• 6+ years of experience in data engineering, pipeline development, or ETL/ELT processes.
• Proven experience building and maintaining data pipelines specifically for machine learning projects.
• Proficiency in Python and SQL.
• Experience with scripting languages such as Bash or Shell.
• Familiarity with cloud platforms including AWS, GCP, or Azure.
• Strong understanding of data modeling principles, data quality measures, and security best practices.

Preferred Skills

• Bachelor’s degree in Computer Science, Data Science, Statistics, or a related field, or equivalent experience.

Key Skills

Education

Any graduate