QwFNfer: custom engine hitting 15+ tok/s on a 16GB GPU
A bespoke inference engine for the Qwen4-style architecture that runs Flash-Next on a 16GB card.

- Launch
- Qwen3.8-Flash-Next
- Use case
- Gaming gpu
- Format
- Repo
- Source
- github.com
Apolog1ze-Dev
A bespoke inference engine for the Qwen4-style architecture that runs Flash-Next on a 16GB card.

Apolog1ze-Dev
sergqwer
@sergqwer · Sep 29
Adds NVIDIA's NVFP4 quantisation to Strata so a single 12GB+ RTX 20 to 50-series card can host the MoE.

DominikBucko
@DominikBucko · Aug 30
Dual-3090 build with 128GB RAM reporting about 4,200 tok/s prefill and 111 tok/s decode on long prompts.
