Prepare Prefill Metadata

Build input ids, positions, cu_seqlens, slot mappings and block tables for prefill. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Medium · KV Cache, Prefill · from Paged KV Cache.

Build input ids, positions, cu_seqlens, slot mappings and block tables for prefill.