Skip to content

vllm.model_executor.layers.fused_moe.fused_flydsl_moe

Fused MoE Triton kernels.

_as_flydsl_ptr(tensor)

Adapt a torch tensor to the pointer ABI expected by AITER FlyDSL.

Source code in vllm/model_executor/layers/fused_moe/fused_flydsl_moe.py 
47
48
49
50
def _as_flydsl_ptr(tensor: torch.Tensor | None):
    """Adapt a torch tensor to the pointer ABI expected by AITER FlyDSL."""
    data_ptr = None if tensor is None else tensor.data_ptr()
    return flyc.from_c_void_p(fx.Uint8, data_ptr)