Support disk radix cache#837

Open

jayfeather9 wants to merge 22 commits intomainfrom

Commits on Jun 26, 2025

initial hicache support not finished

jayfeather9
authored and
jinbiaoyu
committed
add debug outputs

jayfeather9
authored and
jinbiaoyu
committed
fixed various bugs

jayfeather9
authored and
jinbiaoyu
committed
add hiradix cache implement untested

jayfeather9
authored and
jinbiaoyu
committed
add thread safety & real mem_manager support

jayfeather9
authored and
jinbiaoyu
committed
delete cache controller

jayfeather9
authored and
jinbiaoyu
committed
add write support

jayfeather9
authored and
jinbiaoyu
committed
finish hi cache support first edition

jayfeather9
authored and
jinbiaoyu
committed
fix minor bug

jayfeather9
authored and
jinbiaoyu
committed
fix minor bug

jayfeather9
authored and
jinbiaoyu
committed
add little fixes, still buggy

jayfeather9
authored and
jinbiaoyu
committed
fix cuda() and type

jayfeather9
authored and
jinbiaoyu
committed
Change to only store prefill

jayfeather9
authored and
jinbiaoyu
committed
format

jayfeather9
authored and
jinbiaoyu
committed
format2

jayfeather9
authored and
jinbiaoyu
committed
format3

jayfeather9
authored and
jinbiaoyu
committed
Support only one GPU store partially with bug

jayfeather9
authored and
jinbiaoyu
committed
fixed problems

jayfeather9
authored and
jinbiaoyu
committed
delete useless codes

jayfeather9
authored and
jinbiaoyu
committed
little bug fix

jayfeather9
authored and
jinbiaoyu
committed
add cli param fix

jayfeather9
authored and
jinbiaoyu
committed
refactor hicache

yujinbiao
authored and
jinbiaoyu
committed