Token Budget Mixed Scheduling

Schedule decode first, then chunk prefills under one token budget. A free ML coding interview task on NudgeCode: write it in Python and check it with tests in your browser. Medium · Scheduling, Chunked Prefill · from Scheduling & Prefix Caching.

Schedule decode first, then chunk prefills under one token budget.