Halogen: fastest Flash-Next server for AMD Strix Halo

An inference engine written for Ryzen AI MAX 395 on Linux and Windows that deploys only Qwen-family MoE models. The author is an automation engineer, not a full-time programmer, who built it to get more out of his mini PC.

Optimised AMD toolchain by a llama.cpp contributor.

Open-source inference engine with an OpenAI/Anthropic-style local API that fits the 125B MoE onto a 12GB consumer GPU plus system RAM. The project behind the model's local-running surge.

Step-by-step recipe to squeeze the 125B model onto one DGX Spark instead of two, with config and measured throughput.