Paged Attention Decode

Read a valid context from shuffled physical blocks and run one GQA decode step. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Hard · Attention, KV Cache, GQA · from Paged KV Cache.

Read a valid context from shuffled physical blocks and run one GQA decode step.