Flash-Next AWQ INT4 on four RTX 3090s
262K context with vision and FP8 KV cache on four used GPUs.

- Launch
- Qwen3.8-Flash-Next
- Use case
- Gaming gpu
- Format
- Repo
- Source
- github.com
Alexey Fateev
262K context with vision and FP8 KV cache on four used GPUs.

Alexey Fateev
sergqwer
@sergqwer · Sep 29
Adds NVIDIA's NVFP4 quantisation to Strata so a single 12GB+ RTX 20 to 50-series card can host the MoE.

DominikBucko
@DominikBucko · Aug 30
Dual-3090 build with 128GB RAM reporting about 4,200 tok/s prefill and 111 tok/s decode on long prompts.
