Creator

lkarlslund

1 entry for lkarlslund from 1 creator on Reddit, published Oct 6.

u/lkarlslund

@lkarlslund · Oct 6

A fork of the NInfer engine reaches 400 tg/s under ideal conditions with NVFP4 MoE experts on a 96GB card and the n-gram table on disk.

Entries