Pinned Loading

1. EricLBuehler/candle-vllm EricLBuehler/candle-vllm Public

   Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

   Rust 718 88

2. xinfer xinfer Public

   Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

   Rust 309 43

3. EnflameTechnology/vllm-gcu EnflameTechnology/vllm-gcu Public

   Python 38 11

4. EnflameTechnology/candle-vllm-gcu EnflameTechnology/candle-vllm-gcu Public

   Python 5 4

5. attention.rs attention.rs Public

   LLM Kernel Library for Rust

   Cuda 31 17

6. xbot xbot Public

   A minimal Rust AI agent for vibe coding and task automation

   Rust 7 1