Description

You will port, enhance, and validate PyTorch-based Large Language Models (LLMs) using CUDA SDK APIs.

Responsibilities

• Port and validate PyTorch-based LLMs on company-specific AI processors using CUDA SDK APIs.
• Extend, modify, and replace CUDA code to optimize performance and meet specific implementation requirements.
• Debug and troubleshoot complex integration issues between CUDA code and PyTorch models.
• Develop and maintain validation frameworks and tools for LLM performance analysis.
• Collaborate with cross-functional teams to ensure seamless hardware-software integration.

Required Skills

• 5+ years of experience in machine learning engineering or related software roles.
• Proficiency in C++ and Python programming.
• Hands-on experience with CUDA programming and CUDA SDK APIs.
• Strong experience with the PyTorch framework.
• In-depth knowledge of Large Language Models (LLMs) and deep learning architectures.
• Proven ability to debug and troubleshoot complex software and kernel-level issues.
• Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.

Preferred Skills

• Experience with AI processor architecture and design.
• Knowledge of TensorFlow or other deep learning frameworks.
• Experience profiling and tuning GPU kernels for speed, memory usage, and scalability.

Key Skills

Education

Bachelor's or Master's degrees