vllm.entrypoints.openai
Modules:
| Name | Description |
|---|---|
api_server |
|
cli_args |
This file contains the command line arguments for the vLLM's |
logits_processors |
|
protocol |
|
run_batch |
|
serving_chat |
|
serving_classification |
|
serving_completion |
|
serving_embedding |
|
serving_engine |
|
serving_models |
|
serving_pooling |
|
serving_score |
|
serving_tokenization |
|
serving_transcription |
|
speech_to_text |
|
tool_parsers |
|