vllm.v1.kv_offload
¶
Modules:
-
base–Core abstractions for KV cache offloading in vLLM v1.
-
config–Normalized configuration consumed by native offloading backends.
-
cpu– -
factory– -
file_mapper– -
fs– -
pointer_utils–Utility functions for resolving device (gpu,tpu,etc) pointers.
-
tiering–