Description

You will build and manage the data infrastructure required to power generative AI and machine learning models.

Responsibilities

• Design and implement data pipelines to collect, process, and store large volumes of structured and unstructured data.
• Integrate data from various sources to ensure quality and accessibility for machine learning models.
• Manage and optimize databases and data warehouses to support retrieval and analytics.
• Create and maintain data models that facilitate effective analysis for AI applications.
• Monitor and optimize data system performance for efficient processing and storage.

Required Skills

• 8+ years of experience in technical roles.
• Proficiency in Python and Java.
• Hands-on experience with Apache Spark and Kafka.
• Expertise in SQL and NoSQL databases.
• Experience building and managing ETL processes and data integration techniques.
• Experience with cloud platforms including AWS, Azure, or GCP.
• Strong understanding of data modeling techniques and best practices.
• Ability to work with large datasets to solve complex analytical problems.
• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

Preferred Skills

• Experience with AI frameworks such as TensorFlow or PyTorch.
• Knowledge of machine learning algorithms, NLP, and computer vision techniques.

Key Skills

Education

Bachelor's or Master's degrees