Variable-Length Attention

Implement varlen attention with cu_seqlens and a bottom-right causal mask. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Hard · Attention, GQA · from Paged KV Cache.

Implement varlen attention with cu_seqlens and a bottom-right causal mask.