ConceptRadix Tree / 压缩前缀树

Radix Tree

A compressed prefix tree data structure that merges and stores paths sharing the same prefix, supporting efficient prefix lookup and sharing; it is commonly used in KV cache management.

Timeline (last 90 days)

Sep 6

vLLM's prefix caching implementation is based on a radix tree data structure for fine-grained cache hit matching.

Unverified50%

All Facts (1)

Unverified

vLLM's prefix caching implementation is based on a radix tree data structure for fine-grained cache hit matching.

50%

Source Articles

Understanding vLLM and SGLang from First Principles: Deconstructing the Core Technologies of Inference EnginesOct 23