Skip to content

Zero-shot benchmark: Laya's advertised win over Jev does not reproduce on four datasets

CamiloSep 20

A frozen-protocol comparison of Jev 1.13, PrismNLI-0.4B and Laya with raw predictions, calibration and latency published. Laya ties Jev on the emotion dataset and trails it by 10 to 33 points elsewhere.

Preview of Zero-shot benchmark: Laya's advertised win over Jev does not reproduce on four datasets
Launch
Laya
Use case
Research
Format
Repo
Source
github.com

Camilo

Dynamic Machine Learning practitioner and Software Developer with transferrable skills in Deep learning.

Your product hereSeen by everyone reading about Laya builds.From $10/week

More built with Laya

See all

AI WITH Rithesh

youtube.com · Sep 24

Video by AI WITH Rithesh covering Laya: Laya Is INSANE… Open-Source AI Just Challenged Jev!. Part of the early wave of tutorials and head-to-head tests after the open release.

Nick Automates

youtube.com · Oct 1

Video by Nick Automates covering Laya: Laya is a Free and Opensource alternative to Jev AI but faster. Part of the early wave of tutorials and head-to-head tests after the open release.

Singularity Feed | AI Models , Agents & Robotics

youtube.com · Sep 24

Video by Singularity Feed | AI Models , Agents & Robotics covering Laya: I Tested Laya: An Open-Source JEV Alternative. Part of the early wave of tutorials and head-to-head tests after the open release.

Open on GitHub