vllm.models.inkling.nvidia.ops ¶

Inkling kernels (NVIDIA).

rmsnorm / sconv import eagerly. The SwiGLU kernels and the FA4 relative-attention wrapper are exposed lazily to keep this package's import path lightweight.

Modules:

• fa4_rel_attention –
• fa4_warmup –

  Startup compilation of the FA4 kernels used by Inkling.

• lamport –

  Deadlock-free fused RS + short-conv + AG + residual + RMSNorm.

• mm_towers –

  Fused CUDA kernels for the Inkling vision/audio towers.

• norm –
• sconv –

  Inkling short-convolution kernels backed by a paged sliding-window state cache.

• silu_and_mul –

  SwiGLU kernels for the Inkling MLP layers.