Flash-Next on dual CMP 170HX mining cards
Community vLLM build that runs the model on cheap ex-mining SM80 hardware.

Community vLLM build that runs the model on cheap ex-mining SM80 hardware.

Niko1221
@Niko1221 · Sep 24
Open-source inference engine with an OpenAI/Anthropic-style local API that fits the 125B MoE onto a 12GB consumer GPU plus system RAM. The project behind the model's local-running surge.
MiaAI-Lab
@MiaAI-Lab · Sep 4
Step-by-step recipe to squeeze the 125B model onto one DGX Spark instead of two, with config and measured throughput.
