GQA Attention

Implement grouped-query attention with a bottom-right causal mask. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Hard · Attention, GQA · from Transformer Inference Building Blocks.

Implement grouped-query attention with a bottom-right causal mask.