Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 83.7k 18.4k

2. guoqingbao/xinfer guoqingbao/xinfer Public

   Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

   Rust 273 36

3. kernel_benchmarks kernel_benchmarks Public

   Python

4. BusDB BusDB Public

   Rust

5. HlsParser HlsParser Public

   Parser for hls playlist files (*.m3u8)

   Go