Description

You will own the backend engineering for data and ML innovation systems.

Responsibilities

• Develop training data pipelines, converting raw data into formats usable by training jobs on GCP and AWS.
• Implement large-scale inference stacks using fine-tuned LLMs for pre-train and post-training data processing.
• Process and filter extremely large, often messy, datasets efficiently.
• Build scalable backend services and APIs to support data access and inspection tools.

Required Skills

• 10+ years of programming experience in Python.
• Extensive experience with concurrency, parallelism, and functional programming concepts.
• Proficiency in REST API design and implementation.
• Experience with large-scale data storage systems, including Redis and VectorDB.
• Solid foundational skills in algorithms, data structures, and OOP.
• Familiarity with streaming processing using Kafka.
• Experience designing, reviewing, and delivering software for large-scale systems.
• Familiarity with build tools such as Jenkins, Docker, or Gradle.
• Experience providing architecture and design guidance.

Preferred Skills

• Familiarity with Java, GoLang, Rust, or Swift.

Key Skills

Education

Any Graduate