Laya Vision: image inputs for Laya's typed decisions

r33drichardsSep 1976 stars

Adds image understanding to Laya using a small SmolVLM-256M backbone, so you can ask calibrated yes/no, choice and score questions about a picture plus text.

Open on GitHub

Preview of Laya Vision: image inputs for Laya's typed decisions

Launch: Laya
Use case: 3D graphics
Format: Repo
Source: github.com

r33drichards

See all

mizorewww

@mizorewww · Sep 19

Validated Core ML ports of all Laya checkpoints. One short multilingual decision in 4.98 ms P50 on M3 Max with ANE FP16, at 2.78x better energy per decision than MLX FP16.

雨夹雪❄️

@mizorewww · Sep 20

The port announcement: Laya on MLX, under 1 GB RAM, choosing the snake’s next move 60 times a second on a local M3 Max.

atomic.chat

@atomic_chat_hq · Sep 21

Atomic.chat ran Laya on a 16 GB MacBook Air against Jev over the API on a Grok-built Tetris. Local won on speed: 11x faster decisions.

codejunkie99

@codejunkie99 · Sep 22

Open on GitHub

Laya Vision: image inputs for Laya's typed decisions

More built with Laya