Skip to content

vllm.v1.engine.exceptions

EngineDeadError

Bases: Exception

Raised when the EngineCore dies. Unrecoverable.

Source code in vllm/v1/engine/exceptions.py 
 8
 9
10
11
12
13
14
15
16
17
class EngineDeadError(Exception):
    """Raised when the EngineCore dies. Unrecoverable."""

    def __init__(self, *args, suppress_context: bool = False, **kwargs):
        ENGINE_DEAD_MESSAGE = "EngineCore encountered an issue. See stack trace (above) for the root cause."  # noqa: E501

        super().__init__(ENGINE_DEAD_MESSAGE, *args, **kwargs)
        # Make stack trace clearer when using with LLMEngine by
        # silencing irrelevant ZMQError.
        self.__suppress_context__ = suppress_context

__suppress_context__ instance-attribute 

__suppress_context__ = suppress_context

__init__ 

__init__(*args, suppress_context: bool = False, **kwargs)
Source code in vllm/v1/engine/exceptions.py 
11
12
13
14
15
16
17
def __init__(self, *args, suppress_context: bool = False, **kwargs):
    ENGINE_DEAD_MESSAGE = "EngineCore encountered an issue. See stack trace (above) for the root cause."  # noqa: E501

    super().__init__(ENGINE_DEAD_MESSAGE, *args, **kwargs)
    # Make stack trace clearer when using with LLMEngine by
    # silencing irrelevant ZMQError.
    self.__suppress_context__ = suppress_context

EngineGenerateError

Bases: Exception

Raised when a AsyncLLM.generate() fails. Recoverable.

Source code in vllm/v1/engine/exceptions.py 
3
4
5
class EngineGenerateError(Exception):
    """Raised when a AsyncLLM.generate() fails. Recoverable."""
    pass