u/turtleninja99@turtleninja99 · Oct 5Got 17.5 tok/s decode and 360 tok/s prefill using a carousel buffer for experts and a second external SSD for parallel reads, both new tricks.
