jevbench: Jev vs GPT-5-mini, Claude Sonnet 5, fine-tuned DistilBERT, BART NLI and Laya

Six classifiers over SST-2, AG News and more, reporting accuracy, macro-F1, ECE, p50/p95 latency, throughput and cost side by side. Laya runs locally on MPS or CPU.

Open on GitHub

Preview of jevbench: Jev vs GPT-5-mini, Claude Sonnet 5, fine-tuned DistilBERT, BART NLI and Laya

Launch: Laya
Use case: Agents
Format: Repo
Source: github.com

Dhruv Mehra

Technology enthusiast

See all

codejunkie99

@codejunkie99 · Sep 22

tswawa

@tswawa · Sep 23

ipenywis

@ipenywis · Sep 21

A port of the jev-ultrafast browser agent that decides with local laya-mlx instead of the hosted Jev API, covering DOM snapshot, executor and safety checks. Runs free on Apple Silicon.

wdobry

@wdobry · Sep 20

Open on GitHub

jevbench: Jev vs GPT-5-mini, Claude Sonnet 5, fine-tuned DistilBERT, BART NLI and Laya

More built with Laya