vllm.distributed.kv_transfer.kv_pipe
Modules:
Name | Description |
---|---|
base |
This file defines an interface |
mooncake_pipe |
|
pynccl_pipe |
This module implements a PyNccl pipe for sending and receiving |
Modules:
Name | Description |
---|---|
base |
This file defines an interface |
mooncake_pipe |
|
pynccl_pipe |
This module implements a PyNccl pipe for sending and receiving |