vllm.v1.sample
Modules:
| Name | Description |
|---|---|
logits_processor |
|
metadata |
|
ops |
|
rejection_sampler |
|
sampler |
A layer that samples the next tokens from the model's outputs. |
tpu |
|
Modules:
| Name | Description |
|---|---|
logits_processor |
|
metadata |
|
ops |
|
rejection_sampler |
|
sampler |
A layer that samples the next tokens from the model's outputs. |
tpu |
|