Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.core.block

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
    core
    
    vllm.core
    
    vllm.core.block_manager
    
    vllm.core.evictor
    
    vllm.core.interfaces
    
    vllm.core.placeholder_block_space_manager
    
    vllm.core.scheduler
    
    block
    block
    
    vllm.core.block vllm.core.block
    Table of contents
    
    block
    
    vllm.core.block.block_table
    
    vllm.core.block.common
    
    vllm.core.block.cpu_gpu_block_allocator
    
    vllm.core.block.interfaces
    
    vllm.core.block.naive_block
    
    vllm.core.block.prefix_caching_block
    
    vllm.core.block.utils
  - device_allocator
  - distributed
  - engine
  - entrypoints
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - utils
  - v1
  - worker
CLI Reference
Community

Table of contents

block

vllm.core.block

Modules:

Name	Description
`block_table`
`common`
`cpu_gpu_block_allocator`
`interfaces`
`naive_block`
`prefix_caching_block`	Token blocks.
`utils`	Block manager utils.

Made with Material for MkDocs