vllm.v1.worker
Modules:
| Name | Description |
|---|---|
block_table |
|
cpu_model_runner |
|
cpu_worker |
|
gpu_input_batch |
|
gpu_model_runner |
|
gpu_worker |
A GPU worker class. |
lora_model_runner_mixin |
Define LoRA functionality mixin for model runners. |
tpu_input_batch |
|
tpu_model_runner |
|
tpu_worker |
A TPU worker class. |
utils |
|
worker_base |
|
xpu_model_runner |
|
xpu_worker |
|