Skip to content

vllm.v1.kv_offload

Modules:

  • base –

    Core abstractions for KV cache offloading in vLLM v1.

  • config –

    Normalized configuration consumed by native offloading backends.

  • cpu –
  • factory –
  • file_mapper –
  • fs –
  • pointer_utils –

    Utility functions for resolving device (gpu,tpu,etc) pointers.

  • tiering –