mizorewww
@mizorewww · Sep 19
Validated Core ML ports of all Laya checkpoints. One short multilingual decision in 4.98 ms P50 on M3 Max with ANE FP16, at 2.78x better energy per decision than MLX FP16.

ConvAI Innovations· Released Sep 18
mizorewww
@mizorewww · Sep 19
Validated Core ML ports of all Laya checkpoints. One short multilingual decision in 4.98 ms P50 on M3 Max with ANE FP16, at 2.78x better energy per decision than MLX FP16.

FluidInference
@FluidInference · Sep 21
Swift package that reads a form in a running Mac app through the Accessibility API, asks an on-device model what belongs in each field, and types it in. ~1 ms per decision.
Alex
@Alex_tra_memory · Sep 21
FluidInference ported Laya to CoreML with 99.5% of ops running on the ANE and benchmarked it at 3.7 ms per decision on an M5 Pro.
lkarlslund
@lkarlslund · Sep 20
Ggml-based C++ runtime for all three checkpoints. Native tokenization, decision heads and JSON output; optimized FP16/BF16 CUDA on RTX with FP32 accumulation, plus Vulkan.

afshinm
@afshinm · Sep 21
Runs the typed-decisions checkpoint on Metal Performance Shaders: ~32 ms median and ~2.1 GiB RAM on M5 Pro, plus a slower ~0.74 GiB low-memory mode. Demo and benchmark included.

yzfly
@yzfly · Sep 20
Convert → quantize → deploy path that turns Laya (and Kev, NanoJev, PlayJev) into an INT8 ONNX service on the official wire protocol. Runtime is onnxruntime, tokenizers, numpy.

vishalmysore
@vishalmysore · Sep 22
Shows Laya's decisions running in WebAssembly to route steps of a workflow, so branching logic works without a hosted model.
ChristianAlexander
@ChristianAlexander · Sep 20
Elixir library that downloads the official checkpoint on first load and answers typed choice and noul questions; pick EMLX on Apple Silicon or EXLA for CPU/NVIDIA.

aovestdipaperino
@aovestdipaperino · Sep 20
No Python, no torch, no ONNX export. Loads the ungated safetensors directly and runs any of the three checkpoints on CPU, Metal or CUDA.

cv
@cv · Sep 20
Unmodified Laya weights, real NES emulation via Stable Retro, text observations from RAM, model-driven jumping. 27.5 s of game time at 16.79 ms median inference.

chneau
@chneau · Sep 20
Dockerized FastAPI service bundling all three checkpoints behind a language router, with timing-safe API keys, OpenAPI docs, triage and moderation presets and bulk inference.

Anton Lobach
@AntLobach · Sep 21
Anton Lobach ported the Laya System 1 engine to Jolt, a Clojure implementation on Chez Scheme. Code in jlt-commons/lev.
bpmforbusiness
@bpmforbusiness · Oct 7
A Java worker that runs Laya's choice, score and yes/no decisions inside Camunda 8 workflows, with versioning and safety checks.

gopaljigaur
@gopaljigaur · Sep 21
Choice, Score and Noul over any System One backend with a confidence policy: if a backend errors or is unsure, the next is tried. Ships a TypeSafe-compatible server.
