SGLang 0.5.20 setup for Flash-Next on one RTX PRO 6000
262K context with exact sampled MTP on a single workstation card.

- Launch
- Qwen3.8-Flash-Next
- Use case
- Workstation gpu
- Format
- Repo
- Source
- github.com
SSH
A developer
262K context with exact sampled MTP on a single workstation card.

SSH
A developer
Niko1221
@Niko1221 · Sep 24
Open-source inference engine with an OpenAI/Anthropic-style local API that fits the 125B MoE onto a 12GB consumer GPU plus system RAM. The project behind the model's local-running surge.
MiaAI-Lab
@MiaAI-Lab · Sep 4
Step-by-step recipe to squeeze the 125B model onto one DGX Spark instead of two, with config and measured throughput.
