BlockManager with Prefix Caching

Implement block allocation, reference counts, chained prefix hashes and reclamation. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Hard · KV Cache, Prefix Cache · from Paged KV Cache.

Implement block allocation, reference counts, chained prefix hashes and reclamation.