Laya inference in Jolt (Clojure running on Chez Scheme)
- Launch
- Laya
- Use case
- Automation
- Format
- Build
- Source
- x.com
Anton Lobach
👨👩👧 Father
Anton Lobach
👨👩👧 Father
mizorewww
@mizorewww · Sep 19
Validated Core ML ports of all Laya checkpoints. One short multilingual decision in 4.98 ms P50 on M3 Max with ANE FP16, at 2.78x better energy per decision than MLX FP16.

FluidInference
@FluidInference · Sep 21
Swift package that reads a form in a running Mac app through the Accessibility API, asks an on-device model what belongs in each field, and types it in. ~1 ms per decision.