Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.v1.spec_decode

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - utils
  - v1
    v1
    
    vllm.v1
    
    vllm.v1.kv_cache_interface
    
    vllm.v1.outputs
    
    vllm.v1.request
    
    vllm.v1.serial_utils
    
    vllm.v1.utils
    
    attention
    
    core
    
    engine
    
    executor
    
    metrics
    
    pool
    
    sample
    
    spec_decode
    spec_decode
    
    vllm.v1.spec_decode vllm.v1.spec_decode
    Table of contents
    
    spec_decode
    
    vllm.v1.spec_decode.eagle
    
    vllm.v1.spec_decode.medusa
    
    vllm.v1.spec_decode.metadata
    
    vllm.v1.spec_decode.metrics
    
    vllm.v1.spec_decode.ngram_proposer
    
    vllm.v1.spec_decode.utils
    
    structured_output
    
    worker
  - worker
CLI Reference
Community

Table of contents

spec_decode

vllm.v1.spec_decode

Modules:

Name	Description
`eagle`
`medusa`
`metadata`
`metrics`
`ngram_proposer`
`utils`

Made with Material for MkDocs