Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.v1.sample.tpu

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - utils
  - v1
    v1
    
    vllm.v1
    
    vllm.v1.kv_cache_interface
    
    vllm.v1.outputs
    
    vllm.v1.request
    
    vllm.v1.serial_utils
    
    vllm.v1.utils
    
    attention
    
    core
    
    engine
    
    executor
    
    metrics
    
    pool
    
    sample
    sample
    
    vllm.v1.sample
    
    vllm.v1.sample.logits_processor
    
    vllm.v1.sample.metadata
    
    vllm.v1.sample.rejection_sampler
    
    vllm.v1.sample.sampler
    
    ops
    
    tpu
    tpu
    
    vllm.v1.sample.tpu vllm.v1.sample.tpu
    Table of contents
    
    tpu
    
    vllm.v1.sample.tpu.metadata
    
    vllm.v1.sample.tpu.sampler
    
    spec_decode
    
    structured_output
    
    worker
  - worker
CLI Reference
Community

Table of contents

tpu

vllm.v1.sample.tpu

Modules:

Name	Description
`metadata`
`sampler`	Sampler layer implementing TPU supported operations.

Made with Material for MkDocs