Laya and laya-multilingual in GGUF
mysSep 20
GGUF conversions of both the English and multilingual Laya checkpoints for llama.cpp-style local runtimes.
- Launch
- Laya
- Use case
- Multilingual
- Format
- Repo
- Source
- huggingface.co
More built with Laya
See all
mizorewww
@mizorewww · Sep 19
Validated Core ML ports of all Laya checkpoints. One short multilingual decision in 4.98 ms P50 on M3 Max with ANE FP16, at 2.78x better energy per decision than MLX FP16.
雨夹雪❄️
@mizorewww · Sep 20
The port announcement: Laya on MLX, under 1 GB RAM, choosing the snake’s next move 60 times a second on a local M3 Max.
