Shows how paging the embedding table to NVMe lets the 180B-class checkpoint run on a single DGX Spark.
0xBakeer
@0xBakeer · Sep 20
Typed-decision server on NVIDIA GPUs or Apple Silicon that speaks the Jev wire format, with coding-agent integrations. Built after a cat woke the author at five on a Sunday.