vllm.transformers_utils.configs.extract_hidden_states ¶
Config definitions for ExtractHiddenStatesModel, to be used with the extract_hidden_states spec decoding method.
vllm.transformers_utils.configs.extract_hidden_states ¶Config definitions for ExtractHiddenStatesModel, to be used with the extract_hidden_states spec decoding method.