vllm.v1.pool.metadata PoolingMetadata dataclass ¶ Tensors for pooling. Source code in vllm/v1/pool/metadata.py 11 12 13 14 15 16 17@dataclass class PoolingMetadata: """Tensors for pooling.""" prompt_lens: torch.Tensor prompt_token_ids: Optional[torch.Tensor] pooling_params: list[PoolingParams] pooling_params instance-attribute ¶ pooling_params: list[PoolingParams] prompt_lens instance-attribute ¶ prompt_lens: Tensor prompt_token_ids instance-attribute ¶ prompt_token_ids: Optional[Tensor] __init__ ¶ __init__( prompt_lens: Tensor, prompt_token_ids: Optional[Tensor], pooling_params: list[PoolingParams], ) -> None