Skip to content

vllm.models.deepseek_v41.nvidia.specialized_decode.logits.logits

Logits of the specialized decode: the low-batch LM head GEMM (lm_head) and vocab-parallel logits gathered with the executor's all-gather.

For decode batches a one-shot all-gather over NVLink multicast is several times faster than the NCCL ring. The executor's LamportAllGather takes the logits when they fit, by size alone, so every TP rank takes the same path; larger ones go to NCCL. vLLM's custom all-gather is not used: its MNNVL Lamport kernel never waits for a rank's own multicast copy (see ops.cute_dsl.all_gather). The all-gather's mailbox also serves the row-sharded indexers, so the logits must be gathered on the forward stream after any side stream has rejoined it.