Description

You will design and implement data extraction systems leveraging Large Language Models.

Responsibilities

• Design, develop, and implement data extraction systems using LLMs like GPT-4.
• Fine-tune and customize LLMs for specific extraction tasks to ensure accuracy and efficiency.
• Build and maintain data pipelines for the extraction, processing, and storage of large datasets.
• Conduct performance testing and optimization of LLMs to enhance extraction capabilities.
• Troubleshoot and resolve issues related to data extraction processes and models.

Required Skills

• 5+ years of experience in software development.
• Proficiency in Python.
• Proven experience with LLMs and natural language processing (NLP) technologies.
• Hands-on experience with TensorFlow or PyTorch.
• Experience with data extraction, ETL processes, and database management.
• Knowledge of AWS, Google Cloud, or Azure.
• Experience with Docker and Kubernetes.
• Strong understanding of data structures, algorithms, and software engineering principles.
• Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field.

Preferred Skills

• Experience with Hadoop or Spark.

Key Skills

Education

Bachelor's or Master's degree