vllm.distributed.kv_transfer.kv_connector
Modules:
Name | Description |
---|---|
base |
KVConnectorBase Class for Distributed KV Cache & Hidden State communication |
factory |
|
lmcache_connector |
LMCache KV Cache Connector for Distributed Machine Learning Inference |
mooncake_store_connector |
MooncakeStore Connector for Distributed Machine Learning Inference |
simple_connector |
Simple KV Cache Connector for Distributed Machine Learning Inference |
utils |
KV cache helper for store. |
v1 |
|