Skip to content

You are viewing the latest developer preview docs. Click here to view docs for the latest stable release.

vLLM

vllm.entrypoints.cli.benchmark

Initializing search

Home
User Guide
Developer Guide
API Reference
CLI Reference
Community

vLLM

Home
User Guide
Developer Guide
API Reference
API Reference
- API Reference
- Contents
  Contents
  - vllm.beam_search
  - vllm.collect_env
  - vllm.config
  - vllm.connections
  - vllm.env_override
  - vllm.envs
  - vllm.forward_context
  - vllm
  - vllm.jsontree
  - vllm.logger
  - vllm.logits_process
  - vllm.outputs
  - vllm.pooling_params
  - vllm.sampling_params
  - vllm.scalar_type
  - vllm.scripts
  - vllm.sequence
  - vllm.test_utils
  - vllm.tracing
  - vllm.version
  - adapter_commons
  - assets
  - attention
  - benchmarks
  - compilation
  - core
  - device_allocator
  - distributed
  - engine
  - entrypoints
    entrypoints
    
    vllm.entrypoints
    
    vllm.entrypoints.api_server
    
    vllm.entrypoints.chat_utils
    
    vllm.entrypoints.launcher
    
    vllm.entrypoints.llm
    
    vllm.entrypoints.logger
    
    vllm.entrypoints.score_utils
    
    vllm.entrypoints.ssl
    
    vllm.entrypoints.utils
    
    cli
    cli
    
    vllm.entrypoints.cli
    
    vllm.entrypoints.cli.collect_env
    
    vllm.entrypoints.cli.main
    
    vllm.entrypoints.cli.openai
    
    vllm.entrypoints.cli.run_batch
    
    vllm.entrypoints.cli.serve
    
    vllm.entrypoints.cli.types
    
    benchmark
    benchmark
    
    vllm.entrypoints.cli.benchmark vllm.entrypoints.cli.benchmark
    Table of contents
    
    benchmark
    
    vllm.entrypoints.cli.benchmark.base
    
    vllm.entrypoints.cli.benchmark.latency
    
    vllm.entrypoints.cli.benchmark.main
    
    vllm.entrypoints.cli.benchmark.serve
    
    vllm.entrypoints.cli.benchmark.throughput
    
    openai
  - executor
  - inputs
  - logging_utils
  - lora
  - model_executor
  - multimodal
  - platforms
  - plugins
  - profiler
  - prompt_adapter
  - reasoning
  - spec_decode
  - transformers_utils
  - triton_utils
  - usage
  - utils
  - v1
  - worker
CLI Reference
Community

Table of contents

benchmark

vllm.entrypoints.cli.benchmark

Modules:

Name	Description
`base`
`latency`
`main`
`serve`
`throughput`

Made with Material for MkDocs