Slack thread routing
Does this channel message belong in a recent thread?
suggest a thread · leave in channel
Example: Slack Thread Police · Source ↗
Decision models return structured answers, such as categories, scores or yes/no probabilities, for games, websites and AI agents. Jev returns these without generating text; some alternatives generate an option letter.
How it works
A message or an agent's history can be input. You can also send a game state or a web page.
For a Choice question, you supply the allowed options and receive probabilities for them.
Use the probabilities to decide which answers to act on and which to send to a person or a bigger model.
The odds above illustrate a Choice question. Jev, and the models built to its API, also take Noul questions, which return a yes/no probability; the name comes from the Bernoulli distribution. A Score question returns a value along your defined scale, which can fall between the numeric levels you supply. source.
A generative LLM can return structured output that your code reads. It generates its answer one token at a time. Jev returns structured answers without generating text. Together reports that Tev1 keeps a text-generation head and is trained to return one option letter. Simon Willison Together
Compare decision models with classifiers, embeddings and rules. See the task results and what each comparison leaves untested.
TypeSafe calls Jev a System One model, after Daniel Kahneman's split between fast, intuitive thinking and slow, deliberate reasoning. Liquid AI uses "decision models" for d1. TypeSafe Liquid
The interface isn't. Scoring declared labels in one pass goes back years, from zero-shot classifiers to GLiNER. What is new is a hosted model sold for it, with calibrated probabilities as its stated training goal, at this price and speed. The lineage
Use cases
The newest builds we've found. Each card links to its use case, with a source for the example.
Does this channel message belong in a recent thread?
suggest a thread · leave in channel
Example: Slack Thread Police · Source ↗
Did the agent verify the caller before discussing the account?
yes · no
Example: Callscore transcript review · Source ↗
Do these authority records refer to the same place?
yes · no
Example: Yale Cultural Heritage AI’s Kev LUX Places · Source ↗
Which proposed value fills this dialogue slot?
candidate values · not specified
Example: laya-slotjudge-m46 · Source ↗
Which end of this column is better?
higher · lower · neither
Example: Practical Data, model picks the scale and code paints it · Source ↗
What topic does this comment discuss?
combat · technical performance · other topics
Example: pbz-comment-insight · Source ↗
Is this fact new, or already known?
new · already known
Example: Hindsight agent memory · Source ↗
Should the on-call engineer be paged now?
page · do not page
Example: Coroot paging benchmark · Source ↗
How many RVs are in this tile?
0 · 1 · 2 · 3 · 4 to 5 · 6 to 8 · 9 to 12 · 13 to 20 · 21 to 35 · 36 or more
Example: clef-playa counts aerial tiles with Clef · Source ↗
Score whether a candidate OCR reading matches its document region.
0 to 1 correctness score
Example: MiniCPM-OCR Jev checks text, formulas and tables · Source ↗
Does the agent talk over the caller?
yes · no
Example: Hume Audio Decisions API docs · Source ↗
Does this vendor support SAML SSO and EU data residency?
yes · no
Example: Parallel Decisions API benchmark post · Source ↗
Does the answer to this question lie under this section?
yes · no
Has the conversation moved to a new topic?
same · subtopic · new_topic
Example: topic-gate · Source ↗
Is this note about a trip?
yes · no
Example: Laya Notes · Source ↗
Is music playing?
yes · no · cant_tell
Could executing this action cause data loss, a charge, a logout, an account or permission change, a message sent to another person, or another irreversible side effect?
yes · no
Does this output follow this rule from the skill?
yes · no
Example: skill-tester · Source ↗
How much reasoning effort does this task need?
low · medium · high
Example: jev-router for Claude Code · Source ↗
Should the bot reply now?
true · false
Example: JEV Damocles for AstrBot · Source ↗
Does this declaration implement the behaviour in the query?
yes · no
Does this claim from the call contradict the reported figures?
yes · no
Example: narrative-audit-jev · Source ↗
Is there room in this shot for one more person?
yes · no
Example: Cameo for ComfyUI · Source ↗
Which project does this file belong to?
Podcast · Client site · Home admin · None of these
Is the user trying to find, track or obtain private information about a specific person?
yes · no
Example: Exposure-aware routing · Source ↗
Does this folder contain only caches, temporary files, crash dumps or leftover downloads that apps recreate?
yes · no
Example: SpaceSniffer, Jev edition · Source ↗
Do the supplied slides include a pricing table?
true · false
Example: idec for local Ollama · Source ↗
Which team should handle this support ticket?
Billing · Technical · Account · Sales
Example: laya-pet ticket router · Source ↗
Is this reply interested?
yes · no
Example: Jev for Marketers guide · Source ↗
Is this issue from someone blocked from upgrading?
yes · no · unknown
Example: Better Backlog for GitHub issues · Source ↗
Which of the options the agent offered should it go with?
Option 1 · Option 2 · Option 3
Example: opencode-auto-question plugin · Source ↗
Does this request need the memory tools?
yes · no
Example: pi-jev-lazy-load for Pi · Source ↗
Which remediation path should resolve this failing custom setting?
Configure devices · Ask users · Fix policy · Review
Example: intune-why for Microsoft Intune · Source ↗
Does this listing match what I'm looking for?
yes · no
Example: Jev Content Filter for classified ads · Source ↗
Which element on this page does the step mean?
Checkout button · Cart icon · First name field · Continue button
Example: Decisium, plain-English UI tests · Source ↗
Which catalogue item is "5# limes"?
Limes, 5 lb · Limes, case · Lemons, 5 lb · none of these
Example: order-matcher for restaurant orders · Source ↗
How does this clause treat users in disputes?
not addressed · standard or protective · somewhat stricter · abusive
Example: Jev ToS Checker for Chrome · Source ↗
What caused this failed test?
environment or timeout · flaky assertion · genuine regression · API contract mismatch
Example: Jev CI triage · Source ↗
Does this news item carry PRC state framing?
yes · no
Example: West Philippine Sea Watch · Source ↗
Does this column hold personal data?
yes · no
Example: jev-pii, PII discovery in DuckDB · Source ↗
What kind of attention does this notification need?
action required · ephemeral interrupt · persistent status · review later · hide
Example: QuietFlow for Android · Source ↗
Does this existing repo already do the same job as the idea?
yes · no
Example: buildornot, a verdict on your side project · Source ↗
What does this villager do for the next two hours?
eat · rest · work · explore
Example: The Village, run on Jev · Source ↗
Can this question be answered from the textbook chapter?
yes · no
Example: Textbook Voice Tutor, Grade 2 · Source ↗
Which major group does this job ad belong to?
Professionals · Associate professionals and technicians · Clerical support workers · Service and sales workers
Example: SSOC 2024 Decision Trail · Source ↗
Has the other person answered this question yet?
yes · no
Example: Call Coach, a live interview checklist · Source ↗
Does this product's text say it contains chicken?
supported · contradicted · unknown · conflicting
Example: Petsona, evidence-backed pet product tags · Source ↗
Is this new paper about humanoid whole-body control?
yes · no
Example: arXiv Jev Digest, a daily screened reading list · Source ↗
Which tissue type is in this slide tile?
tumour · normal · inflamed · none of these
Example: PathJev, decisions on pathology slides · Source ↗
Should this agent's request reach the controller?
allow · cache · defer · deny
Example: Talos gate for AI agents on factory networks · Source ↗
Is this email for you?
for you · to review · junk
Example: Mail Triage, on-device with Laya · Source ↗
Does this post match my interests?
show · hide
Example: LinkedIn Focus Filter, in-browser with Kev · Source ↗
Does this record's text match the question?
yes · no
Example: Laya inside DuckDB · Source ↗
How big is this request?
question · small change · big change · too vague
Example: ClauJev, Jev checking Claude Code · Source ↗
Should the agent talk now?
speak · keep listening · yield · mm-hm
Example: TYGER full-duplex voice agent · Source ↗
Does this pipe pass inspection?
pass · defect · recheck
Example: OpenCV + Laya inspection workbench · Source ↗
Should this bash command run?
allow · block
Example: guardrails-md for coding agents · Source ↗
Will this happen by the deadline?
yes · no
Example: Three decision models vs Polymarket and Kalshi · Source ↗
What should the player do next?
left · right · jump · wait
Example: Mario, played from emulator state · Source ↗
Which element on this page gets clicked?
search box · results · next page
Example: browser-use: flights in 7.1 s · Source ↗
What's the next action on screen?
click · type · scroll · done
Example: typesafe-computer-use · Source ↗
How relevant is this result to the query?
a score on a scale
What do we do in this block?
buy · sell · hold
Example: jev-trader, one decision per block · Source ↗
Where does the drone go next?
forward · left · right · climb
Example: Camera-input drone in simulation · Source ↗
Is this commit a security fix?
yes · no
Example: commit-miner · Source ↗
Is this element clutter?
yes · no
Example: unclutter browser extension · Source ↗
Models
Hosted models, open weights you can run yourself, and the community projects around them. Tap any entry for what it is, what its maker claims, and where that claim comes from.
TypeSafe AI · 15 Sep 2026 · HOSTED
The model that named the category. A hosted API: send your app's state plus typed questions (Choice, Score or Noul) and get a probability back for each answer. It generates no text, and its weights are not public.
Source: Announcement → Source: Jev 1.14 → Source: Docs → Source: On OpenRouter → Source: Experimental Box primitive →
OpenAI · Public beta launch: 6 Oct 2026 · HOSTED
OpenAI's Decisions API uses GPT-6 Luna to return typed answers for classification, routing and agent actions. It launched in public beta on 6 Oct 2026 and became generally available on 22 Oct. Developers supply the questions and allowed answers; the endpoint returns probabilities, choices or rubric scores.
Liquid AI · 29 Sep 2026 · HOSTED
Liquid AI's decision model family. The hosted d1 takes the same three question types as Jev (Noul, Choice and Score). On 7 Oct Liquid released two small open siblings you can run on a device, and on 15 Oct a bigger hosted one, d1-ultra, joined OpenRouter. On 27 Oct d1.1, the successor to d1, joined OpenRouter at the same price, with -latest aliases that follow each family's newest version. On 27 Oct Liquid announced two more open models, d1-2B (text, pictures and video) and d1-Omni-2B (adds audio), built on LFM3; their Hugging Face repositories went up on 24 Oct.
Source: Docs → Source: Announcement → Source: Decision Index → Source: Open d1 release → Source: d1.1 on OpenRouter → Source: d1-2B →
Inception · 30 Sep 2026 · HOSTED
Inception's decision model, served as a System One endpoint: send state and typed questions, get a choice, a score or a yes/no answer, each with a probability.
Upstage · OpenRouter announcement: 28 Sep 2026 · HOSTED
Upstage's decision endpoint, available through OpenRouter. The date is when OpenRouter announced it; we have not found an announcement from Upstage itself. A faster sibling, Solar Decide Flash, joined on 8 Oct 2026 with a 524K context.
Source: OpenRouter → Source: OpenRouter announcement → Source: Solar Decide Flash →
Respan · 24 Sep 2026 · HOSTED
A one-pass classifier for agent traces. For each behaviour you define, it returns the probability that it is present, absent or not observable, without generating text. Respan's later Span-02 (15 Oct 2026) reads images too, can return a number directly, and ships as Apache-2.0 open weights.
Source: Announcement → Source: Span-02 → Source: Span-02 weights (Apache-2.0) →
meraGPT · HOSTED
A hosted decision model served only at /v1/systemone, the request format TypeSafe's SDK speaks. Its site doesn't say who runs it or when it launched.
Microsoft · 9 Oct 2026 · HOSTED
Microsoft's decision-scoring model for routing, classification, prioritisation, verification and workflow control. Post-trained from Qwen3.5-9B, available in Microsoft Foundry and on OpenRouter.
Cloudflare · 9 Oct 2026 · HOSTED
The Clef family on Workers AI answers typed questions in one pass. Clef-omni adds audio and video, so it can decide about what is seen and heard at the same time. The same update cut Clef-flash to $0.038 per million input tokens.
Snowflake · 8 Oct 2026 · PREVIEW
A decision model you call from SQL. It classifies, scores, filters and routes rows inside Snowflake through AI_COMPLETE. A lower-latency Decision Fast, with REST access, followed on 19 Oct.
Celeris · 8 Oct 2026 · HOSTED
A closed decision model for text, structured data and images that can give a one-sentence reason alongside each probability.
Subquadratic · Snap 1.2 release: 11 Nov 2026 · API
Subquadratic reports a 384K-token context for text and images. Snap 1.2's reported price is $0.04 per million input tokens. Subquadratic's 11 Nov 2026 release note says requests using retired subq-snap-1.1 and subq-snap-preview IDs route to 1.2, and advises retesting thresholds because decisions and probabilities may change.
Source: Announcement → Source: Version 1.1 release → Source: Baseten → Source: API models, status and pricing → Source: Baseten launch, 02 Nov 2026 → Source: Snap 1.2 release and retired IDs →
ScaleDown · OpenRouter listing: 13 Oct 2026 · HOSTED
Scores text or a whole document against your own choice, yes/no and ordered-scale questions. Request-compatible with Jev's Decisions API. The date is OpenRouter's listing.
Cloudflare · 19 Oct 2026 · PREVIEW
A new branch of the family: a System One extraction model. Where a decision model picks from answers you list, Clairic extracts, computes, estimates or forecasts values from unstructured input and returns them as typed answers: an invoice total, a delivery date, a repair cost, a 24-hour traffic forecast. It does this quickly, without an LLM writing prose.
Source: Announcement → Source: OpenRouter listing → Source: OpenRouter decisions inventory (34 entries, checked 4 Nov 2026) →
Parallel · 25 Oct 2026 · HOSTED
A decision engine that searches the live web before it answers. You send typed questions about a company, product or policy, and one call returns typed answers with probabilities (or a refusal) plus a shared list of the web pages it used, so it can answer things a model only knows from training data cannot, such as whether a company has an open job right now.
Source: Announcement → Source: Docs → Source: Benchmark → Source: Benchmark announcement → Source: OpenRouter launch and promotion → Source: OpenRouter decision inventory →
Jared Palmer · 1 Oct 2026 · OPEN
Kev is Jared Palmer's family of open, Jev-compatible decision models, from 0.8B to 27B parameters. A pointer head on a Qwen base scores each option, and the API matches TypeSafe's, so their SDK works against a local Kev server. Kev 1.0, released 1 Oct 2026, pins the family's checkpoints, model cards, evaluation suites and serving code; it introduces no newly trained weights.
Source: GitHub → Source: Kev 1.0 release → Source: Hugging Face → Source: Kev 4B on OpenRouter → Source: GitHub API: stars →
DecisionTune · Hugging Face repository upload: 4 Oct 2026 · OPEN
A local decision model built on ModernBERT-large: give it a state, a question and options, and it returns a probability for each option in one encoder pass. It handles choice and yes/no questions without generating text, through PyTorch, MLX or ONNX. The open weights are under Apache-2.0. The date is when the weights repository went up on Hugging Face.
Together AI · 23 Sep 2026 · OPEN
Together's Jev-inspired experiment: a Qwen3.5-4B fine-tune that reads a state, a question and 2 to 24 lettered options. Together says plainly it is not a non-autoregressive runtime like Jev: it keeps a standard next-token head and generates its answer as one letter.
Source: Hugging Face → Source: GitHub → Source: Announcement → Source: Untuned 4B baseline test →
Fastino · 24 Sep 2026 · OPEN
A 340M-parameter encoder decision model from the team behind GLiNER, fine-tuned from GLiNER2. It scores the allowed answers to typed questions in one pass and is small enough to run on a CPU.
Convai Innovations · 18 Sep 2026 · OPEN
A non-autoregressive decision engine on ModernBERT-large (421M), with a 322M multilingual sibling. Its author, Nandakishor Mukkunnoth, says he built the same approach a year before Jev launched.
Source: Site → Source: GitHub → Source: Model card and preprint citation →
Bespoke Labs · 18 Sep 2026 · OPEN
A 9B decision model, LoRA-tuned from Qwen3.5-9B, with its 2,676 training examples published. One of the first two models in Ollama's decision support. Bespoke Labs followed with hosted Nimble v4 (9B) and v4-max (27B) on 13 Oct 2026.
Source: GitHub → Source: Ollama → Source: Hugging Face → Source: Nimble README →
vLLM Semantic Router · 22 Sep 2026 · OPEN
Open decision models from the vLLM Semantic Router project, published as "Decision 1.0: towards open decision foundation models". Six were announced on 22 Sep. The follow-up, Decision 3.0 (d3), is Apache-2.0 and reads text, images and video, with sizes up to 27B.
Source: Hugging Face → Source: Announcement PR → Source: d3 on Hugging Face →
Perplexity · 6 Oct 2026 · OPEN
Perplexity's decision model reads text and images and returns a probability for every answer. It ships as Apache-2.0 open weights and as a hosted API. V1.1 (27B) halved the price on 6 Oct; V1.2 and a 4B Decider Flash followed on 20 Oct.
Source: V1.2 announcement → Source: Hugging Face → Source: V1.1 announcement →
Nace.AI · 6 Oct 2026 · OPEN
Drex 2.0 returns probabilities over typed answers for text, with open weights under Nace.AI's Open RAIL licence. Drex Max (13 Oct) adds images and screenshots; its 27B weights are now public under Nace.AI Open RAIL-M. Drex Max Finance followed on 01 Nov 2026 as a hosted model. The entry's date is Drex 2.0's release in Nace.AI's model table.
Source: Model table → Source: Hugging Face → Source: Drex Max weights and local inference → Source: Drex Max Finance API guide → Source: OpenRouter decision inventory →
H2O.ai · 7 Oct 2026 · OPEN
frontier-infra · 10 Oct 2026 · OPEN
Open decision models that read option-label probabilities in a single pass with thinking switched off: you get a pick and a confidence, not an essay. GGUF and MLX builds sit next to the full weights. Released 10 Oct 2026, written up on 16 Oct.
FrontiersMind · 14 Oct 2026 · OPEN
A 27B open decision model that answers in English, Hindi, Tamil and Kannada. The makers say Jev still leads on some reasoning benchmarks.
IBM · 15 Oct 2026 · OPEN
IBM's switchable models do chat, decisions and speech-to-text from one endpoint. 4.1 adds a general-purpose Decision adapter that speaks the /v1/systemone interface.
NineNineSix · 17 Oct 2026 · OPEN
A decision model for speech. It listens to the microphone and your text-to-speech at the same time and keeps deciding whether to speak, keep listening, yield or drop in an "mm-hm", scoring audio in 80 ms frames streamed in 320 ms hops. Built for full-duplex voice agents, with an open-source agent (tyger-s2s) on top.
Source: Hugging Face → Source: Announcement → Source: Voice agent →
Tractian · Repository and weights upload: 22 Oct 2026 · OPEN
A decision model that stands between AI agents and the controllers that run factories. Every Modbus or OPC UA request goes through one gate, where a small model decides in a single pass to allow it, answer from cache, defer it or deny it, and every decision is logged. The date is when the repo and weights went up.
Baseten (Base Labs) · 21 Oct 2026 · OPEN
Two open decision models from Base Labs, Baseten's research team: mammoth-1 (27B) and elephant-1 (9B), post-trained from Qwen3.5. They read text and images and return a probability for every option of each question, with all questions sharing one prefill of the state. Baseten launched them claiming the top spot on the community Jev Decision Index. On 29 Oct a third, smaller model joined: joey-1 (2B, built on Qwen3.5-2B), pitched as the fastest and cheapest.
Source: Announcement → Source: Technical report → Source: mammoth-1 on Hugging Face → Source: elephant-1 on Hugging Face → Source: joey-1 →
labqoat · Hugging Face weights upload: 20 Oct 2026 · OPEN
A tiny open decision model that runs locally, built on Qwen3.5-0.8B and reading text and images. The date is when the weights went up on Hugging Face.
decido-ai · Weights upload: 7 Nov 2026 · OPEN
Six English document-decision packages share the decido API. Decido-1, Max and Think use Gemma-4-26B-A4B; Fast uses Qwen3-1.7B, Ultra Qwen3-0.6B and XL DeepSeek-V4-Flash. Max distils a three-model research mixture into one checkpoint and generates up to 1,024 reasoning tokens before reading option probabilities. The Max package’s GPU serving path is still being validated.
Source: Decido-1 card and weights → Source: Fast card and weights → Source: Ultra card and weights → Source: Think card and weights → Source: Max card and weights → Source: XL card and weights →
Arc53 (DocsGPT) · Hugging Face v0.2 upload: 11 Oct 2026 · OPEN
The small decision model inside DocsGPT, used for quick judgements such as whether a message is a prompt injection or whether a chunk answers the question. It runs on CPU with ONNX Runtime. The date is when v0.2 went up on Hugging Face.
Valen Team · First Hugging Face weights upload: 5 Oct 2026 · OPEN
Open Qwen3.5-based decision models for text, images and video. The 1.5 family adds 9B and 27B sizes alongside 0.8B, 2B and 4B. Both Jev System One and OpenAI Decisions request formats are supported. Native 1.5 weights were uploaded on 9 November; the original family dates to October.
Source: Site and demo → Source: Hugging Face → Source: 1.5 card and weights → Source: 1.5 public result records →
Sivasuthan · Weights upload: 24 Oct 2026 · OPEN
An open decision model for images: give it a photo, document, receipt, chart or screenshot plus a typed question and it returns a probability for every allowed answer, served over Jev's System One API. The date is when the weights went up.
egma-ai · Hugging Face weights upload: 27 Oct 2026 · OPEN
An open decision model that listens instead of reading: give it an audio clip and a typed question (how does the speaker feel? does the pitch rise?) and it returns a probability for every option, without a transcript. It is Qwen3-Omni-30B-A3B with frozen weights and a decision head in place of the text output. The date is when the weights went up on Hugging Face.
Crele · Hugging Face weights upload: 30 Oct 2026 · OPEN
A decision model for live audio. You ask yes/no questions in plain English (is music playing? is someone speaking?) and it answers every 40 ms of a stream with yes, no or can't tell, real time on a laptop CPU. The date is when the weights went up on Hugging Face.
Fastino · Weights repository upload: 19 Oct 2026 · OPEN
Fastino’s decision-model family spans 0.4B, 0.8B, 2B, 9B and 27B releases. Each returns option probabilities without generated reasoning. Inputs and serving behaviour vary: the 0.4B encoder and 9B release accept text or JSON and reject images; the original 27B entry supports images. Public weights use Fastino’s community licence, and Fastino also hosts a System One API.
Source: Hugging Face → Source: API docs → Source: Decision Index → Source: Family announcement → Source: 0.4B card and weights → Source: 9B card and weights →
Daniel van Strien · 28 Oct 2026 · OPEN
A 380M-parameter decision model for data curation: give it a web page, prompt, maths problem or library record and typed questions (topic, format, educational value, difficulty) and it returns a probability for every option. The release centres on its recipe: the data-building and training scripts are public, with source and labeller/licence metadata where known, and 516,964 of the 535,730 training rows are released (web text omitted).
PelaAI · First Hugging Face family release: 7 Oct 2026 · OPEN
A fast-moving family of open decision models from PelaAI, trained in an agent-driven data loop, with English and Chinese in mind: from 0.8B up to 35B-A3B, with new generations posted every few days. The newest big one, KnowLine-31B-Gen1 on a Gemma 4 base, went up on 23 Oct. The date is the first family release on Hugging Face (4B-Gen1).
Ollama · 28 Sep 2026 · RUNTIME
TheoLeeCJ · COMMUNITY
Reproduces Jev's interface pattern with open models: it reads typed option probabilities directly from a model, with no answer sentence and no decoding loop. Runs in your browser, or at home on a GPU, Apple Silicon or CPU. Independent of TypeSafe, and it does not reproduce Jev's model or training.
bnsd55 · COMMUNITY
Parallel constrained decisions for local models through mlx-lm on Apple Silicon: the schema is a set of typed fields, the context is prefilled once and broadcast across one batch row per field. MIT licensed. Large answer sets may be chunked rather than done in a single pass.
kw2828 · COMMUNITY
A browser and local playground for decision experiments on memory, uncertainty and control, using Qwen-family models and returning option probabilities. MIT licensed. Its README states it is independent of Jev, of openjev.com and of zhihz/openjev.
akash-kamat · COMMUNITY
Gemma 3 270M with a scoring head, producing a decision in a single forward pass with no text generation. Code and adapter weights are publicly readable, but the repository carries no licence, so it is not open source in the legal sense. The Gemma base weights remain under their own separate terms.
leofmarciano · COMMUNITY
Groot 1 S, a 149M-parameter open typed-decision model that speaks the System One request format and reads states of up to 64k tokens in the maker's tests. Its forward pass also ships in the Bend language.
jwuthri-cloud · COMMUNITY
A self-hosted decision model with a Jev-compatible API: you run the server on your own GPU, and a 230 MB vision adapter on Qwen3.5-4B reads text and images. Python SDK, server and fine-tuning in one package.
prismhq · TOOLING
A LiteLLM-based router with an optional Jev decision backend: when a TypeSafe API key is configured it can use Jev to pick a model per request, and otherwise falls back to its own rules-based decider. MIT licensed.
mizorewww · TOOLING
Runs the open Laya decision models natively on Apple Silicon with MLX: no PyTorch, no cloud API, zero output tokens. Its demo plays Snake, calling Laya for every move with a safety layer that can override unsafe ones. Apache-2.0, and more starred than any project on our list except browser-use's jev-ultrafast.
Hume AI · 2 Nov 2026 · HOSTED
Hume's hosted model answers questions about speech and sound with probabilities. Send one MP3 or WAV recording, 5 seconds to 5 minutes long, with questions in plain language. It supports yes/no, choice, score and time-span answers, and returns no transcript. Hume says the probabilities estimate how human raters would respond.
Source: Announcement → Source: Product and playground → Source: Docs → Source: Billing → Source: Audio preparation → Source: Launch changelog → Source: Python SDK →
Zoom · 19 Oct 2026 · HOSTED
Zoom's hosted Decisions API and Decisions API Pro accept text, images or both. Define several questions about the same input and get structured answers in one call for condition checks, option selection and scoring.
Source: Product, playground and pricing → Source: Launch changelog →
Ant Digital Technologies (蚂蚁数科) · 22 Oct 2026 · HOSTED
Ant Digital Technologies' System One model for choosing answers to business questions, including native multi-select and decisions ordered by dependencies. IT之家 reported its 22 Oct 2026 launch in 4B and 27B versions for customer service, risk and finance. Ant's current DTMaaS listing describes the lingdt-decision-1.0 endpoint as a 4B test model.
Source: DTMaaS model page → Source: Official model data and API example → Source: API guide → Source: Launch report (IT之家) → Source: Jev pricing source → Source: Microsoft-Decision-1 source →
besktech (beskvladimir-create) · First Hugging Face repository creation: 1 Nov 2026 · OPEN
A Russian-first typed-decision model built on mmBERT-base (307M), with a separate scoring head. It runs on CPU and supports yes/no, choice and ordinal scales. The maker says it is unaffiliated with TypeSafe AI and was not trained on Jev outputs. The v1.3 card documents improved option-wording robustness and withdraws an earlier calibration comparison.
Source: Weights and v1.3 model card → Source: GitHub → Source: Release metadata →
InternLM · First Hugging Face upload: 26 Sep 2026 · OPEN
Send a shared state, named questions and optional images to these multimodal models. A single forward pass returns an answer distribution for every question, without generating text. The Qwen3.5-based family has 0.8B, 2B and 4B sizes.
Source: 4B weights and model card → Source: GitHub → Source: Report → Source: Hugging Face upload metadata →
OpenBMB · First Hugging Face upload: 23 Oct 2026 · OPEN
This 2B specialist scores whether a candidate OCR reading matches a document region. It handles text, formulas and tables, returning a score from 0 to 1. Qwen3.5-2B supplies the backbone; a binary classification head replaces its language head. Scores can help select among OCR engines or route uncertain regions to a person.
Source: Weights and model card → Source: Code and deployment → Source: JevOCRBench → Source: Hugging Face upload metadata →
Vectorize (Hindsight) · 3 Nov 2026 · OPEN
Vectorize's Hindsight team fine-tuned this 0.8B model from Qwen3.5-0.8B for agent memory. It returns probabilities for choice, score and yes/no questions in one pass. Hindsight first tried these judgments with Jev, then trained its own model to check whether facts are new and evidence is enough. It uses the same System One request shape.
Source: Launch and evaluation → Source: Weights and model card → Source: Hindsight code → Source: System evaluation →
Abacus.AI · Maker blog announcement: 2 Nov 2026 · OPEN
Abacus.AI's 4B decision model answers a typed question about audio, an image or text with a probability per option in one pass. It is a Gemma 4 E4B-it fine-tune. The family includes a 744M audio model and a LiteRT build for phones. Each 4B request takes one audio clip up to 30 seconds or one image, with up to 20 options.
Source: Weights and model card → Source: 0.7B audio tier → Source: LiteRT build → Source: Maker blog announcement → Source: X announcement: 3 Nov 2026 →
REAX · 3 Nov 2026 · OPEN
REAX 1.3 runs two model parts on one GPU and averages their per-option probabilities 50/50. One blends a Bittensor subnet 92 miner fine-tune with KnowLine; the other blends a miner fine-tune from Mammoth-1's lineage with Decision 1.0's d3-ultra. Its interface accepts Jev-style requests. The hosted service at decisionmodels.io and the Hugging Face account decisionmodels belong to a separate business unrelated to decisionmodels.ai.
Source: Weights, results and upstream notices → Source: REAX Engine → Source: Announcement →
ONYULTEA · First Hugging Face upload: 3 Nov 2026 · OPEN
A Korean-specialised 9B decision model based on Qwen3.5-9B, trained with int8 LoRA at rank 32. It reads a state and typed questions, then returns probabilities over the options in one forward pass. The first public release supports choice and yes/no questions through a Jev-compatible /v1/systemone server.
Source: Weights, licence declaration and results → Source: Serving and evaluation code → Source: Weight file inventory →
Morph · OpenRouter listing date: 3 Nov 2026 · HOSTED
Morph's hosted 27B decision model is based on Qwen3.5. It answers choice, yes/no and score questions about text, JSON or images, returning probabilities without generating text. The System One endpoint supports several questions about a shared state, with automatic prefix caching for repeated input.
Source: Documentation → Source: OpenRouter listing → Source: Launch post →
GyrTechnology · v0.3 weight update: 7 Nov 2026 · OPEN
A 0.8B decision model fine-tuned from Qwen3.5-0.8B. It reads a shared state and isolated question segments in one forward pass, returning probabilities for choice, yes/no and score questions. The release includes serving code and weights without a text-generation head. Its non-commercial licence limits how it can be used.
Fight Fire with Fire Robotics · Beta-3 release; first release 20 Oct 2026: 4 Nov 2026 · OPEN
An encoder-only decision model family built on Ettin, with 0.4B and 1B sizes. It returns typed answers alongside evidence spans, a relation to the state and an abstention estimate. It encodes and caches the state before seeing questions. Beta-3 adds non-decisive rule outcomes and a field-extraction adapter; the first release was 20 Oct 2026.
Source: 1B model card and weights → Source: 0.4B model card and weights → Source: Runtime and recipes →
typestrict (Lucas Duarte) · Public release: 4 Nov 2026 · OPEN
A 150M pull-request decision model built on TS-Ettin-150M. It asks five fixed questions about a diff, covering description agreement, review difficulty, compatibility, test coverage and security. Its 8-bit ONNX package runs the questions in one CPU pass. The questions use choice and yes/no answers; this is a specialist package.
Source: Model card and package → Source: Model page and audit → Source: Release history →
Kingsoft Office · Public release: 4 Nov 2026 · OPEN
A d3-flash fine-tune with typed choice, yes/no and score answers for text, JSON, images and videos. It keeps the Qwen3.5-9B multimodal architecture and decision readout. The bundled Transformers runtime extends score questions to 255 ordered levels; the documented vLLM build keeps the upstream 10-level limit.
stonefish-labs · Public release: 4 Nov 2026 · PRE-RELEASE
A pre-release 4B d3-mini fine-tune for reviewing code written or run by an agent. It reads the task, repository baseline, behaviour summary and change, then returns three fixed decisions about class, intent and scope. The static extractor never runs the code being inspected. It is intended to rank items for further review.
Source: Model card, weights and results → Source: Release history →
eltokh7 · Public release: 4 Nov 2026 · OPEN
A public-preview family for simulated survey respondents, fine-tuned from Kev at 4B and 27B. It returns option probabilities from persona traits and a question, with training intended to make answers respond to prices, odds and payoffs. The 27B release has merged weights; 4B has a LoRA adapter and pointer head. Its tests check economic consistency, with no validation against real people.
Source: 27B card and merged weights → Source: 4B card and adapter →
Aryan Srivastava · Public release: 4 Nov 2026 · OPEN HEADS
A visual-inspection decision model built around Muse Glimmer 30B. The release supplies two small logistic heads for a fixed manufacturing-defect question, plus a temperature for zero-shot scoring; the backbone is downloaded separately. A head must stay paired with its exact prompt, image resize and object noun.
Source: Heads and model card → Source: Code and run records →
Christophe Cruz, Hussam Ghanem and Hocine Cherifi · Model-card release: 4 Nov 2026 · OPEN
A multilingual Laya fine-tune that chooses a proposed value for a dialogue slot or answers not specified. It needs candidate values from another component and does not extract spans. The released seed was selected on development data from three training seeds; its card reports results for 46 training languages and five held-out languages.
Finic · HOSTED
Finic's hosted fraud and risk decision model returns probabilities for yes/no, single-choice and multiple-choice questions. The ask endpoint uses grayson-1 and accepts structured case data or free-text context. The separate score endpoint builds a 0 to 1,000 risk score from a scoring model calibrated with labelled records. An HN comment surfaced it on 04 Nov 2026; its release date is unconfirmed.
Source: Vendor and model identity → Source: Typed questions → Source: Pricing → Source: API contract →
Butler Compute · Hugging Face package release: 5 Nov 2026 · OPEN
A Qwen3.5-35B-A3B decision fine-tune with 3B active parameters. It reads text, chat or up to four images and answers typed questions from option-letter logits, without generating an answer. BF16 and NVFP4 packages are public under Apache-2.0; the maker identifies NVFP4 as its production format.
Source: BF16 card and weights → Source: NVFP4 package → Source: Release history →
NewsBang · 9B v5 and 0.8B v5 weight releases: 8 Nov 2026 · OPEN
Qwen3.5 typed-decision models in 9B v5 and 0.8B v5 packages, with a separate 255-option head and noncausal attention in their full-attention layers. Both include merged weights and the Decider-derived System One server. Overlong question branches are refused instead of truncated.
Source: 9B v5 card and package → Source: 0.8B v5 card and package →
Songkai · First Hugging Face package release: 5 Nov 2026 · OPEN
A Qwen3.5-0.8B model with seven fixed heads for Chinese enterprise group chats. One pass labels category, sentiment, importance, urgency, intensity, attention and to-dos. K-IM-Deiction V2 ships merged weights, an optional adapter and an MLX port. The private chat data is not released.
Source: K-IM-Deiction card and merged weights → Source: Package history →
Yale Cultural Heritage AI · Hugging Face package release: 4 Nov 2026 · OPEN
Two Kev-4B adapters check whether linked authority records describe the same place and whether a declared parent contains a child place. They supply pointer heads and calibration temperatures, with the Qwen3.5-4B base downloaded separately. The part-of adapter continues training from the equivalence adapter.
Source: Equivalence card and adapter → Source: Part-of card and adapter →
Grizzlykw · Hugging Face package release: 4 Nov 2026 · OPEN
An independent Qwen3-0.6B text decision starter with a frozen backbone and a trained 1,025-parameter compatibility head. It uses no LiquidAI weights. Each question-option pair repeats the state in its own input row, so candidate count adds work and memory. The package includes weights, code, splits and a training report.
Source: Card and standalone package → Source: Training report →
macmacmacmac · Hugging Face package release: 4 Nov 2026 · CUSTOM LICENCE
A Qwen3.5-4B-Base LoRA and Kev head for authorising outgoing tool calls. Bootstrap code fetches the pinned backbone and Kev source. The card leads with the full held-out test and warns that a threshold calibrated on development data transfers badly across domains.
DevsHub · Hugging Face package release: 4 Nov 2026 · LOCAL BUNDLE
A local CodeSync bundle with 29 fixed judgments about user turns and shell commands. The same v3 release now includes Q8_0 and Q4_K_M GGUF files plus a standalone Python runner for Ollama. Unsupported questions inside CodeSync go to its cloud judgment service. No model licence is supplied.
Abubakar Abid · Hugging Face package release: 5 Nov 2026 · OPEN
A Qwen3.5-2B LoRA for one forum-spam question. It reads yes/no token logits as a spam probability after supervised training on the dataset’s training split. It is independent of TypeSafe’s hosted Jev and needs the separate Qwen base.
Toby-NoSkillSon · Hugging Face package release: 4 Nov 2026 · OPEN
A text-only d1-2B fine-tune that decides whether transcribed speech is for a voice assistant, still unfinished or meant for someone else. It runs through MLX on Apple Silicon. The fixed question was trained around the names Toby and Heimdall; the state can supply other names. The weights preceded this scan window; the in-window card explains their lineage.
Bineric · HOSTED
A European hosted decision-model family with 9B and 27B API choices. It accepts text plus yes/no, choice and scale questions through /v1/zuse, returning probabilities without generated answers. The paper studies 4B, 9B and 27B adapters; the public API page lists 9B and 27B. Its release date is unconfirmed.
Source: API, limits and prices → Source: Paper and evaluation limits →
Shanghua Gao · First Hugging Face package release: 5 Nov 2026 · OPEN
Qwen3.5-derived decision models with text exits at different depths. The 4B package has 32 decoder layers; the 3.30B sibling keeps its first 20 layers and existing heads without retraining. Both read text and up to four images, returning option probabilities without generated text. Images use the full depth of the chosen package. Their runtime supplies option echo and prefix-bidirectional attention.
Source: Model card and files → Source: 3B package and correction to the 4B release score →
tory-labs · 2026.11.08.1 trained release: 8 Nov 2026 · OPEN
A Korean-focused Laya multilingual fine-tune. Release 2026.11.08.1 continues from the previous original float checkpoint on private knowledge-graph and research summaries. It ships armD-final-epoch-3 as Q8_0 and original float weights. The maker records a release override with prior-task retention and news checks still unrun; it is not a selection-protocol pass.
Lucasgitguy-co · d1/MiniMind-JEV licence clarification; Laya weights uploaded 6 Nov: 5 Nov 2026 · MIXED LICENCES
Four local move-ranking fine-tunes for Spot’s Biscuit Snake: d1-2B, d1-3B, MiniMind-JEV and Laya Multilingual. The game supplies safe moves; the model ranks them to imitate a heuristic teacher that leaves the most open room. Keep the game’s collision checks. The d1-2B, d1-3B and MiniMind-JEV weights were uploaded on 5 November; the Laya Multilingual weights were uploaded on 6 November.
Source: Model card and files → Source: d1-2B card and weights → Source: MiniMind-JEV card and weights → Source: Multilingual card and weights →
DreamBlooms · Hugging Face package release: 5 Nov 2026 · OPEN
A LoRA decision adapter on LLaDA-MoE-7B-A1B-Instruct. One masked forward pass returns a probability distribution over option letters, with no generated answer. The base weights must be downloaded separately. Use its bundled inference script for the recorded scores; it repairs a rotary-embedding compatibility issue.
harishvs · Hugging Face package release: 5 Nov 2026 · CUSTOM LICENCE
A decision adapter and readout head trained on the text decoder of Nemotron-3-Nano-Omni-30B-A3B. The adapter combines three training runs. The same weights can read images, video and audio through the base’s frozen encoders using the tagged multimodal runtime. Media were not used in training. The repository’s main branch and released package versions cannot load this base.
Source: Model card and files → Source: Multimodal runtime and evaluation →
GyrTechnology · v2 decision-only package release: 5 Nov 2026 · NON-COMMERCIAL
A Qwen3.5-4B full decision fine-tune that returns probabilities for typed questions in one forward pass. The v2 release replaces the earlier full-model files with a decision-only package; v1 remains tagged. Its licence restricts use to non-commercial purposes because some training sources are research-only.
MachinePulseAI · Hugging Face package release: 5 Nov 2026 · OPEN
A text-only Gemma-4-31B-it fine-tune with a linear readout over supplied options. One pass answers choice, noul and score questions. The checkpoint contains vision weights, but the runtime does not use them. Its probabilities have not been calibrated.
Source: Card and weights → Source: Weight licence and effective date → Source: Separately licensed inference code →
Chaoliang Yan · Hugging Face package release: 5 Nov 2026 · OPEN
An independently maintained 2.21B typed-decision model with a frozen vision tower. Its diagnostic continuation raises the reported public score but fails its pre-registered calibration guard. The required renderer, attention mask and verdict readout ship with the weights; generic chat runtimes do not reproduce its probabilities.
Nikita Kolmogorov · Hugging Face package release: 6 Nov 2026 · OPEN
Two multilingual Laya fine-tunes copy Jev judgments for Telegram messages and Farcaster casts or accounts. The Telegram bot uses a 0.81 deletion gate and exempts admins. Farcaster ships Platt scaling for its raw scores. The evaluations measure agreement with the teacher, including its mistakes.
Source: Telegram card and weights → Source: Farcaster card and weights →
OmniJev · OneJev1.6g weight release: 8 Nov 2026 · OPEN
A Gemma-4-31B-it decision family served through Flide. The 1.5g package describes screenshots, photographs and text; the newer 1.6g card documents text and choice, noul and score questions. No new image capability is inferred from the earlier package, and neither card supplies a measured accuracy or calibration result.
Poindexter Labs · First Hugging Face package release: 4 Nov 2026 · OPEN
Poindexter Labs publishes 31B and 57B structured-decision packages with System One servers. The 57B combines Gemma-based and Qwen-based components and accepts text or JSON. The 31B Transformers path reads text; its image path requires compatible SGLang serving. Probabilities need validation on the deployment task.
Source: Card, code and weights → Source: 57B card, weights and serving requirements →
aidendle94 · Hugging Face package release: 4 Nov 2026 · RESEARCH PREVIEW
A research d1-2B fine-tune for proposed agent actions, followed by a 10,240-weight output-head edit. Fixed questions cover risk, review, injection and authorization. The card corrects an earlier evaluation whose question selection revealed labels. Long states are truncated at 8K tokens, and authorization remains weak.
Sarvam AI · Hugging Face package release: 3 Nov 2026 · OPEN
A Sarvam-105B decision fine-tune, offered as custom FP8 weights and a hosted API. It returns option probabilities without generating text. Choice options are sorted by key before scoring. The hosted API and downloadable runtime have different context limits.
Source: Launch and evaluation → Source: Card, runtime and weights → Source: Hosted API limits and price →
Kakao · Weights upload: 6 Nov 2026 · OPEN
A text/image decision model built on Kanana-2-v-3b. It compares state/question embeddings with candidate embeddings and returns option probabilities. Candidate embeddings can be cached. The supplied HTTP server processes one request at a time.
Andra Labs (Amartya Sai Andra) · Weights upload: 6 Nov 2026 · OPEN
A Qwen3.5-2B fine-tune with an Unsloth Clef decision head, intended to choose sections in table-of-contents retrieval. It was trained on general typed decisions. Retrieval, citations and final answer writing remain the application’s job; table-of-contents routing quality is unmeasured.
Tane Piper · Weights upload: 7 Nov 2026 · OPEN
A Kev-0.8B fine-tune that judges shell commands for termite. It asks whether a command only reads, keeps secrets hidden or could do harm, and can rank candidates. The 0.2 weights are rebuilt from documented training sources. In termite its judgment can only tighten the rules; harmful commands can still pass the model.
Maziyar Panahi · Weights upload: 6 Nov 2026 · OPEN
A Qwen3.5-4B LoRA and Unsloth decision head for next-action and tool routing. Training used 17,600 source-labelled rows; the name refers to the larger merged data pool. Jev answers were excluded from training. It is unsuitable as a general trace judge.
tachara-ai · Weights upload: 6 Nov 2026 · OPEN
A Gemma 4 12B fine-tune with merged weights for the decisio runtime. Its commit rule pushes yes/no probabilities inside the 0.20 to 0.80 band to that band’s edge on the same side. This preserves the winning answer while changing calibration.
jmc0 · Weights upload: 6 Nov 2026 · OPEN
Open 0.8B and 4B decision models that steer a separate chat model using rules supplied per request. Turn and partial-draft judgments can request tools, enforce an opening phrase or stop a reply. Rein returns decisions; the chat model writes the text.
Source: Model card and weights → Source: 0.8B card and weights →
Wang Xiaolong · Weights upload: 6 Nov 2026 · NON-COMMERCIAL
A Qwen3.5-4B text/image decision fine-tune with merged weights and a Jev-like API. Its runtime uses bidirectional attention within the state and repeats some inputs. Plain causal inference produces different probabilities. This research preview is noncommercial.
souvickdascmsa019 · Weights upload: 6 Nov 2026 · OPEN
A Qwen3.5-0.8B LoRA plus an Unsloth Clef head for fixed sheets of regulatory and general questions. The calibration split was left unused, so this release is uncalibrated. It is intended for triage and routing, with mixed expert and teacher label provenance.
JD Industrials · Weights upload: 1 Nov 2026 · OPEN
A Qwen3.8-27B decision system that combines vision features with frozen PaddleOCR v5 transcriptions. OCR and image encoding run concurrently on one GPU. Published vision scores and timings cover the whole system; the internal decision backbone alone omits OCR.
Qi Li and Xinchao Wang (NUS) · Weights upload: 9 Oct 2026 · OPEN
A text decision model with Qwen3.5-4B backbone, adapter and a separate decision head. It supports choices, yes/no and rubric scores, with an explicit none-of-the-above option. The authors design its candidate readout for option reuse and reordered candidate sets.
Galal Ban Amr · Selected weights upload: 7 Nov 2026 · OPEN
A Laya fine-tune that labels English descriptions of simulated sensor tracks as drone, bird, aircraft or unknown. It classifies only, with no flight-control or engagement outputs. Training and testing use the same simulator with separate runs; the results say nothing about real sensors or airspace.
Source: Model card and weights → Source: Recorded metrics → Source: Synthetic dataset →
newrexlabs · Weights upload: 7 Nov 2026 · NONCOMMERCIAL
Three sparse MobileMoE decision fine-tunes for English text or JSON. They score supplied options in one forward pass, with a pointer head and temperature scaling by question type. Weights use a noncommercial research licence; inference code is Apache-2.0. Training code and data are not released.
Source: Small card and weights → Source: Medium card and weights → Source: Large card and weights → Source: Inference code → Source: Licence →
Thomas Tesche · Weights upload: 7 Nov 2026 · OPEN
An English Laya fine-tune for a Minecraft agent. Code removes impossible actions; the model chooses an intent and answers a danger question, then an executor acts and a verifier checks progress. The encoder is frozen during this training run. Its reported evaluation contains training or calibration overlap.
Source: Model card and weights → Source: Training and evaluation report → Source: Agent source →
Amaljith · Weights upload: 7 Nov 2026 · RESEARCH ONLY
An English medical-text decision fine-tune continued from a MedGemma 1.5 4B derivative. It scores typed options without generated text. Minority-class oversampling changes the decision balance, with gains and regressions across questions. Research use only, not for diagnosis, triage, clinical decisions or patient care.
Source: Model card and weights → Source: Per-question results → Source: Derivative notice →
JuneYao · Weights upload: 2 Nov 2026 · OPEN
A Qwen3.5-4B LoRA for supplied medical answer choices, mainly in Chinese. It reads next-token option logits in one forward pass and returns probabilities without an explanation. This is independent of TypeSafe’s hosted Jev. The released adapter is for teaching and offline research, not clinical use or triage.
Source: Model card and adapter → Source: Source and evaluation → Source: Released runtime record →
Ashan0525 · Weights upload: 8 Nov 2026 · OPEN
A Qwen3.5-4B derivative that reads text or images and returns probabilities for Choice, Noul and Score questions without generating an explanation. The release includes full model weights, a separate decision readout and a System One server.
Logits · Weights upload: 7 Nov 2026 · OPEN
Two text decision packages. Sigma-1 merges a LoRA into Gemma 4 31B and reads option-code logits. Duo averages option probabilities from a modified KnowLine 31B and d3-ultra, both in FP8. Above 50,000 request characters, Duo uses its first member alone.
Source: Sigma-1 card and weights → Source: Duo card and weights → Source: Duo source-data disclosure →
landtml · Weights upload: 8 Nov 2026 · OPEN
A d1-2B LoRA for checking whether a supplied answer is supported by its source. It returns one response-level support probability, without identifying unsupported spans. Use the recorded source/request/answer fields and the exact question from the card.
Source: Card, weights and evaluation → Source: Scoring code → Source: Licence →
kinasr · Weights upload: 7 Nov 2026 · OPEN
A d1-2B fine-tune for choosing a replacement DOM element when a browser-test locator breaks. It reads an annotated screenshot, broken-locator details and live candidates, with an Unknown option for a missing target. The card gives no held-out accuracy or false-heal rate.
LiamDB · GitHub weight release: 8 Nov 2026 · NON-COMMERCIAL
A CPU decision model family. Amada 3.1 uses mmBERT-base to answer yes/no, choice and ordered-score questions, with a separate probability that the text does not provide the answer for yes/no questions. Downloads pair an ONNX model with its tokenizer.
Source: Code, model description and limits → Source: 3.1 release and weights → Source: Licence →
Mert Kaya (Eschatia Labs) · October weights; catch-up discovery: 1 Oct 2026 · OPEN
Three Intern-Decision-4B fine-tunes: Deem-4B for English, Karar-4B for Turkish and Wähler-4B for German. They return per-option probabilities through the System One API. Optional extensions add unknown, conformal answer sets or a short generated reasoning trace; reasoning is off by default. This is a catch-up October release.
Source: Code, licence and serving → Source: Deem English card → Source: Karar Turkish card → Source: Wähler German card → Source: Recorded live requests →
jmc0 · Hugging Face weight release: 8 Nov 2026 · OPEN
A Qwen3.5-4B chat checkpoint with a decision readout trained through 64 added token embeddings. The original backbone weights stay frozen; a separate copy of the output table keeps the trained input rows out of chat generation. Rule questions read option-letter probabilities, while the same model file also writes dialogue. A decision still needs a prefix pass over the conversation; it is not free work inside an ordinary chat response.
Eren Terakye · Hugging Face weight release: 8 Nov 2026 · OPEN
A Laya fine-tune that copies a scripted lunar-lander autopilot for Low Gate. The package supplies PyTorch weights, the MLX conversion used in the benchmark, training data and hashes. It is an artifact for one simulator and prompt, with manoeuvres selected from a fixed menu.
Source: Card and checkpoints → Source: Training report → Source: Low Gate benchmark →
quincyqiang / yanqiangmiffy · Hugging Face weight release: 8 Nov 2026 · OPEN
A Qwen3.5-4B LoRA fine-tune with a pointer head that scores markers beside the supplied candidates. Multiple questions about one state share a sequence. The pointer readout removes the letter-based 26-option cap, but all input still has to fit the runtime. The model selects among supplied options and has no abstention mechanism.
Source: Card and weights → Source: Scores and request counts → Source: Serving and training code →
k2021211255 · Hugging Face weight release: 8 Nov 2026 · OPEN
A full-parameter Qwen3.8-27B vision decision fine-tune with a separate head and a frozen evaluation engine. A forward pass returns probabilities across supplied choices without generating text. The released package includes weights, inference code, manifests and full public vision-suite records.
Source: Card, code and weights → Source: Pinned public results → Source: Weight licence →
kadirbekovvv / doxanocap · Pinned V1.6 package at 06:55 UTC; catch-up verification: 8 Nov 2026 · OPEN
A Qwen3.5-9B LoRA decision model with a separate 255-option head. The pinned V1.6 package returns one zero-based choice and ordered probabilities through POST /decision. It needs the public custom loader; it does not generate explanations or tool calls. The package predates this scan window, while the availability clarification appeared during it.
Source: Current V1.6 card → Source: Pinned package → Source: Loader and licence → Source: Package manifest →
Mahesh Deshwal · Hugging Face weight package release: 8 Nov 2026 · OPEN
A 3.93B full fine-tune of Domyn-Edge-SFT for text decisions. It reads probabilities over option-letter logits in one forward pass. The card provides Transformers and vLLM recipes; the served vLLM path requests one output token. Its public JevBench submission is awaiting a sealed evaluation.
Source: Card and weights → Source: Evaluation report → Source: Pending JevBench adapter →
Jyler · Hugging Face weight package release: 9 Nov 2026 · OPEN
A fine-tune of Liquid AI’s d1-omni-600M for a Clash Royale course project. It reads a text game state and up to four candidate plays, including tactical notes, retrieval and knowledge-graph context. The package selects a play; the surrounding agent uses iPhone Mirroring on a Mac. Intended for research and the course demo in Training Camp or friendly battles.
Ken Jo · Hugging Face weight release: 9 Nov 2026 · OPEN
Two pruned QEV v3 models for text and image questions. The maker removes eight of 24 language-model blocks and trims the input vocabulary to 32,768 rows, then distils a decision readout. They return option probabilities, a typed answer and a separate abstain flag. Ken Jo's QEV family is separate from labqoat's Qev 0.8B.
Source: 2B compact card and weights → Source: 0.8B compact card and weights → Source: Licence →
Supersonic Labs · Published weights and Python runtime; September catch-up: 25 Sep 2026 · OPEN
A 144.3M-parameter multilingual encoder adapted from mmBERT-small to score supplied options. It accepts named Choice, Noul and ordered Score questions, with a Python runtime for CPU or CUDA. This September release was found through an overnight card edit.
Source: Card, runtime and weights → Source: CPU results → Source: Checkpoint provenance →
Strands Labs · Hugging Face weight release: 9 Oct 2026 · OPEN
A LoRA adapter and option-scoring head on Qwen3.5-2B-Base for Choice, Noul and Score questions. This v1 release averages three training runs and supplies a System One server. Its optional vision path keeps the base vision tower without image training. The community SageMaker project deploys the separate Strands Decider 2B hobson-v19 checkpoint.
Source: Card, adapter and run records → Source: Licence → Source: Runtime and training code →
Javier Marín · First published package release; October catch-up: 31 Oct 2026 · OPEN
A CPU decision model that scores supplied options against a fixed zero-energy none state. It packages an encoder derived from multilingual-e5-small, ONNX weights and a fitted head. Its runtime sorts options into a canonical order before scoring, so order consistency belongs to the complete serving path.
Source: Code and bundled model → Source: Saved comparison → Source: Licence → Source: Model manifest → Source: Package releases →
Gevaert Lab · Hugging Face weight release: 10 Nov 2026 · OPEN
Medical decision models in two sizes, built on Qwen3.5-4B and Qwen3.8-27B with a trained decision head. They read text and images and return probabilities for each supplied option. These are research models; the card requires independent validation and clinician review before patient decisions.
Source: 4B card and weights → Source: 27B card and weights → Source: 4B configuration → Source: Licence →
Q Project · Hugging Face weight release: 10 Nov 2026 · OPEN
A small Russian/English decision model with a custom hybrid backbone and decision head. The 1110 checkpoint adds toxicity and profanity training. It scores supplied options, with reversed-order averaging enabled by default; that serving choice uses two orders.
Source: Card and weights → Source: Licence → Source: Runtime →
Holdout Labs · Hugging Face weight release: 9 Nov 2026 · OPEN
An English game-scene decision model derived from Ettin-400M, with ONNX files and a Python runtime. It scores NPC intent, mood and quest questions, with optional abstention and 42 compiled adapters. The runtime adds option-order averaging and a minor-safety guard; raw ONNX does not include either.
Source: Card and files → Source: Training run record → Source: Data sources → Source: Licence →
Taobao MNN · First published Hugging Face package; October catch-up: 15 Oct 2026 · OPEN
A text decision package with the MNN-Pocket-0.3B backbone, an unmerged LoRA adapter and a pointer head. It returns probabilities for supplied choices, yes/no questions and ordered scores. The bundled Transformers/PEFT runtime keeps the full backbone and language-model head.
Source: Card and weights → Source: Runtime → Source: Calibration record → Source: Licence →
Rayline · Hugging Face weight release: 10 Nov 2026 · OPEN
A Qwen3.5-0.8B-derived router that predicts model success and token use separately from the prices supplied by an application. The package includes routing and content-signal heads plus a general question head. Sage and Swift are policies on the same model.
Source: Card and release files → Source: Policies → Source: Provenance → Source: Licence → Source: Public plugin and limits →
BIGAI · Hugging Face weight release: 10 Nov 2026 · OPEN
A four-size family with Qwen3.5 hybrid backbones and native decision heads. It scores supplied candidate meanings for Choice, Noul and Score questions without generating text. Published decision results are text-only; retained vision components do not establish image accuracy.
Source: 2B card and code → Source: 0.8B package → Source: 4B package → Source: 9B package → Source: 9B request limits → Source: Licence →
Semantique Team · Hugging Face weight release: 10 Nov 2026 · OPEN
Trained candidate-scoring heads for frozen Qwen3.5-0.8B and 4B backbones. Each package contains the head, temperature calibration and an execute-or-escalate policy, with a separate backbone download. The English/Italian training and evaluation situations are synthetic.
Source: ANT-4B card → Source: ANT-08B card → Source: 4B metrics → Source: 08B policy → Source: Licence →
ken11 · Hugging Face weight release: 10 Nov 2026 · OPEN
A Japanese decision adapter and pointer head trained on Sarashina2.2-0.5B with the Strands Decider recipe. It returns Choice, Noul and Score answers through strands-decider. This is a community release, with a separate base download or a merged Q8_0 GGUF.
Source: Card and packages → Source: Training configuration → Source: Request configuration → Source: Licence →
Ainvest-World · Hugging Face weight release: 11 Nov 2026 · OPEN
A text-only Gemma 4 31B fine-tune that scores supplied option tokens without generating an answer. It reads complete inputs twice when they are at most 3,000 tokens before repetition, handling each question separately. The package includes full BF16 weights and its inference code.
Source: Card and inference package → Source: Licence → Source: Third-party terms → Source: Weight manifest →
NewTokenEra · Hugging Face weight release: 11 Nov 2026 · OPEN
A Chinese/English post-trained Qwen3.8-27B decision model with full BF16 weights. Its decide method scores a 26-slot decision head once per question and returns Choice, Noul or Score answers, without generating text. Its reported N-bank evaluation was also used during interface development.
Source: Card and weights → Source: Licence → Source: Provenance → Source: Evaluation record → Source: Typed inference implementation →
submsk · Hugging Face weight release: 10 Nov 2026 · OPEN
A provisional Italian sentence classifier fine-tuned from Laya multilingual. It finds explicit statements of missing knowledge or experience in interview-practice answers. This is a fixed two-class encoder and head, separate from Laya’s general typed-question heads; it does not assess competence or choose interview moves.
Source: Card and weights → Source: Licence → Source: Checksums and provenance → Source: Pilot and integration record →
Google DeepMind · Google announcement: 11 Nov 2026 · API
A multimodal decision API for text, images, audio, video and PDFs. It returns yes/no probabilities, a choice or a rubric score without generating text. Questions share the input but cannot see each other’s answers; application code combines the results.
Source: Launch and billing → Source: API guide → Source: Model limits → Source: OpenRouter listing → Source: Independent test, code and per-answer records →
igorktech · Hugging Face weights, 15:42:55 UTC: 11 Nov 2026 · OPEN
A small typed-decision encoder for text, with a separate femto-asr speech frontend. It scores options in a forward pass per question. The maker’s speech tests show that audio frames help on familiar recording conditions but add no benefit on unseen phone speech.
Source: Card and weights → Source: Inference code → Source: Licence → Source: Configuration →
AI Anytime · Hugging Face weight upload, 19:54:59 UTC: 11 Nov 2026 · OPEN
A Laya fine-tune that assigns clinical notes to a fixed menu of medical-specialty and document-type labels. Snapcall supplies the loader and System One server. Its published test concerns document classification; it does not validate diagnosis or clinical care.
Source: Card and weights → Source: Evaluation record → Source: Training and serving toolkit →
Claims are marked vendor-reported until someone independent reproduces them. Inclusion is not endorsement, and nobody pays to be listed. Something missing or wrong? if@decisionmodels.ai
Projects
Each one opened and checked against its own repo, with star counts as of the day each was added. Jev, released on 15 September 2026, is behind 102 of the 172 projects; the other 70 run on 36 other named models, or on models people load locally. Checked 03 Nov 2026, GitHub search returned 11,206 public repositories matching "jev" created from 15 to 30 September, and 27 created from 11 to 14 September.
Hindsight uses hs-decide-1-flash to prune and deduplicate recall, check whether evidence answers a request, consolidate new facts and decide whether a memory could change a knowledge page. It first tried this with Jev. In the team's own Hindsight 1.2.0 evaluation, glm-5.3-flash plus the decision model scores 87.1 at $7.72 per thousand cases, against 89.0 at $147 for gemini-3.8-flash alone. Reflect quality falls with some LLMs. gemini-3.1-flash-lite judges all runs and also appears in the comparison.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Zurich to London on Google Flights in 7.1 seconds, including model calls, generated text, browser work and loading waits. Swapping to a decision model took median task time from 9.450s to 7.092s and median browser protocol calls from 1,092 to 101.
One natural-language goal, on the real web, at 1x speed. Maker-reported: three repeats of one task on one browser profile.
Figures from the project's own README and docs/performance.md. The maintainers note this is three repeats of one task on one browser profile, not a general benchmark.
A CLI that uses Jev to find source files and context for coding agents. Its author-run ten-task study reports 25.8% lower estimated total task cost with 8/10 solves in both conditions. A later change cut Jev cost about 59%, but raised combined cost 2% to 3% against that saved cohort, again with 8/10 solves.
Catch-up September experiments, discovered through an in-window push. The ten Python tasks were repeatedly studied; saved baselines were not rerun. Costs include failed attempts and use list-price estimates, not reconciled invoices. Nineteen empty responses leave some later usage unknown; the report gives a ceiling.
Source: GitHub → Source: Licence → Source: Total-cost run → Source: Later combined-cost study → Source: Provider code →
Attempts one trade decision per Monad block on the Kuru MON-USDC market, and holds when the model misses the block deadline.
A pixel-art racer where d1 picks left, centre or right on every tick, with a mode that races it against Jev. Liquid AI's own example, in their cookbook repo, so the star count is for the whole repo.
OCRs the screen, then classifies the next action. The claimed per-step cost is the maintainer's own figure, not independently measured.
YOLO-E locates objects and a local d3-lite Q8_0 model answers up to four typed questions per crop. The standalone RVC4 app keeps live video separate from the background decision worker and shows the input crop beside its answer. Luxonis publishes a warehouse demo and reports on-device tests, without matched accuracy or crowd-throughput measurements. Requires Luxonis OS 1.40 or newer.
Vendor demo and on-device execution report; not independently reproduced
Source: Application licence → Source: Runtime → Source: Demo and requirements → Source: On-device report →
A staged review workflow with a local dashboard: each stage is a bounded judgement rather than a written critique.
An agent that plays Super Mario Bros. by classifying the next action from structured emulator state rather than generating a plan.
A local agent workflow tool written in C. Its recap command sends each session transcript to Solar Decide, which labels every statement as a goal, decision, constraint, done or noise before a chat model writes the summary.
A browser extension that decides, element by element, what on a page is clutter, with reusable template rules.
A drone experiment in MuJoCo with a small judgement model in the control loop, on camera input. The maintainer calls the harder tunnel run a partial result.
An LLM plans, reads and writes; Jev picks each action from the controls indexed on the page, and code stops irreversible clicks without authorization. On 46 tasks run three times each against the hosted Browser Use agent, it passed 99.2% of runs to 96.3% and cost $0.0296 a run to $0.3180, 10.7x less, but was slower: 18.9 s a task to 15.3 s (published campaign release-0.7.1).
Scores every sentence of a video and renders the running result as an overlay.
A paper-trading research app where Jev makes the decisions, wrapped in an animated 3D command center with model pets and a ten-timeframe research panel. Every trade is simulated; there is no real order path.
A local inspection workbench: OpenCV measures the image, hard rules decide anything numeric, and a Laya decision model cross-checks the result. Built for fruit picking, weed and pest monitoring, and steel pipe and textile checks. Version 3.0 also trains your own Laya-format decision models.
A browser voice agent where the TYGER decision model is the ears: it transcribes you and decides when you've finished, when you've cut in, and when to say "mm-hm", while an LLM writes the replies.
QA for Remotion videos: code measures every frame, the Sage decision model answers yes/no questions about each one, and only the frames it flags go on to the slower critics.
Classifies git diffs and messages into bug fixes, security fixes with CWEs, and change types.
Checks coding-agent tool calls with rules and a local multilingual Laya fine-tune, returning allow, review or block. VENDOR-REPORTED, base to fine-tune: the model alone held 32 then 39 of 43 attacks and allowed 25 then 44 of 50 everyday commands. Six end-to-end verdicts improved and two worsened, missing a preset no-regression criterion. Accuracy on 162 held-out training rows rose from 0.611 to 0.852. The author inspected the benchmark and evaluation sets between training runs, so they are less independent than a fresh test.
An inference engine that shares state processing across question branches and serves /v1/systemone. In the email demo checked on 12 Nov 2026, the team reports eight questions per email with OneJev1.6-0.8B in bfloat16 on one H200, and 28 seconds for 10,000 emails from 64 clients. This is a throughput example, not a spam-accuracy result.
Author-run records; no fresh model inference reproduced
Source: Licence → Source: Server → Source: Verification code → Source: Email demo and timing setup →
A Telegram bot that checks spam and links related messages before deleting them, with admin exemptions and a keep-on-failure policy. Its published evaluation records 75 live Jev calls, including two rejected prompt changes. Those calls did not exercise Telegram deletion. The README says its production classifier is now a Laya fine-tune distilled from Jev.
Licence, implementation and recorded live model calls checked 6 Nov 2026; no fresh Telegram run.
Source: Licence file → Source: Integration code → Source: Recorded model calls →
A decision layer over reusable embeddings and recorded outcomes. Its download-free CPU quickstart uses authored vectors; text input needs a separate frozen reader and trained head. Code, an arena runner and a recorded-run manifest are public. The head has separate redistribution permission, and the docs warn that probabilities are not calibrated across tasks.
Maker's code and recorded runs · VENDOR-REPORTED; not independently reproduced
Source: Licence → Source: Recorded arena run → Source: Head and reader terms →
Routes lead, contact and issue forms with Jev through Vercel AI Gateway and the AI SDK. It accepts Jev's destination when confidence is at least 95%; otherwise, or if Jev fails, openai/gpt-6-luna-fast evaluates the submission independently. The result shows the destination, deciding model, timings and an email preview, with optional delivery.
A live site where OpenAI Decisions, Jev and Cloudflare's Clef put a probability on live questions after reading recent news, never the odds. Their probabilities are compared against Polymarket and Kalshi prices.
Decision models forget everything after each answer; Nouli keeps a session. Type facts as you learn them and start a line with ? to ask a new question; earlier facts and answers stay in the history. A Rust CLI and library that can chain sessions into decision graphs, with Jev through its TypeSafe adapter or other providers.
Scores option labels and an implicit none state using a bundled ONNX encoder and fitted head. The maker publishes saved comparisons, model hashes and fitting code. Canonical option sorting and one-case inference are part of its consistency recipe. The 900-case matched comparison reports 53.6% correct including none, with half the cases having no right option. Short input budgets and truncation flags remain explicit.
A small decision model scores every bash command against your GUARDRAILS.md in about 100 ms (maker's figure), before an opencode, pi or Claude Code agent runs it. Commands scoring above the threshold for data loss, secret leaks or rule breaks are blocked; the README warns it can still let risky ones through.
Local System One server and CLI for Deem, Karar and Wähler, with optional unknown answers and short reasoning. The maker publishes 390 live requests across the three languages, including misses. Emberwick plays recorded model decisions in a browser village; those replays are not fresh inference.
Source: Licence → Source: Decision engine → Source: Recorded live requests →
A Claude Code plugin that asks Jev short typed questions while Claude works: how big is this request, is this command destructive, was the work really done. It suggests an effort level per request, and in enforce mode a confident check can block a "done!" when the work looks incomplete.
A self-hosted Slack bot that privately suggests moving a channel message into a thread. Jev checks the recent message window by default; a local System One server can replace it. A person chooses whether to move or ignore the message. Debug logging can include Slack payload text.
README screenshots and integration code; not independently run
Source: Licence → Source: Detection code → Source: Privacy and model settings →
A native DuckDB extension that adds seven Jev-style SQL functions backed by a local Laya model: DuckDB handles geometry and distance, Laya reads the text fields. It uses no hosted model or API keys.
A Chrome extension asks a decision model which HTML table columns to shade and which end is better. Code parses values and paints the colours. The default free provider forwards table text to Jev; users can supply their own provider key or use its Cloudflare backend. The README reports colour-or-leave-plain matching 284 of 285 labelled columns on 26 pages. Labels and thresholds were tuned on those pages, so this is a regression check. The replay uses recorded model answers and does not retest the model.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
A Hermes memory provider, Python library and MCP server that asks remote Jev to match stored memories against an agent’s criteria. A frozen predecessor scores 85.8% final-answer accuracy versus Mnemosyne’s 48.3% on a custom 120-question LongMemEval-S test. The renamed release has not had a fresh independent quality test; eligible memory text leaves the machine.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
Runs Bespoke Nimble-9B and three Laya checkpoints as players over the same 200 seeds of a headless Slay the Spire simulator, zero-shot and fine-tuned. The results are the authors' own.
A drop-in React inspector that turns an app's Jev requests into interactive diagrams of the context, each question and the returned answers. Marked experimental.
A local web page and CLI that reads a repo's GitHub issues and lets you filter them by typing a criterion, such as people blocked from upgrading. Each criterion is asked of a decision model through your TypeSafe key or a gateway; add another to narrow the list.
A local app you point at a messy folder like Downloads: it works out which of your projects each loose file belongs to, reading the README or CLAUDE.md in your code folders, and files it into a matching folder under your chosen output location. Nothing moves until you press Move, and one click puts it all back.
Native Swift and MLX inference for local d1 text, images and speech, with a shared HTTP server and an older von backend. The author publishes Python reference vectors and layer-by-layer parity measurements. Head-logit differences are 5.8e-5 absolute for d1 and 6.0e-5 for von. These are implementation checks, without a task-accuracy benchmark. The HTTP wire accepts text states; native Swift calls carry media.
Author-run reference vectors and source checked 6 Nov 2026; not rerun locally.
Source: Licence file → Source: d1 terms → Source: Integration code → Source: Reference vectors → Source: Port verification →
Benchmark code and a 362-question test set that sends each item to Jev and to Kev 4B, and reports accuracy, calibration, latency and cost.
Tests Span-01 Lite as a second check on whether narration text is in the right language, after a regex pass, against a general chat model. The author notes the 23-case test set is small.
Classifies Apple Mail messages as for you, to review or junk with a Laya model running on your own computer, and shows a report of what it would do. Mail never goes to an external AI service, and it never deletes anything.
A Chrome extension that hides LinkedIn posts that don't match your stated interests, using Kev 0.6B running in the browser on WebGPU. Post text never leaves the browser.
A decision model for histopathology: given a tissue image, a question and candidate answers chosen at run time, including 'none of these', it returns a probability for each in one forward pass. Built on MedGemma-1.5-4B with LoRA adapters and a decision head, with code to rebuild every number in the authors' preprint.
Runs an open System One model locally on Apple silicon against ten medical benchmarks, from USMLE-style questions to emergency-department admission and 30-day readmission, and compares it with zero-shot LLMs and supervised baselines.
A DeepSeek Harness plugin where Jev, via OpenRouter, judges each message as simple, standard, complex or escalated and raises or lowers only the reasoning effort of the model you picked. If Jev fails, it switches itself off.
Each ant is a Jev agent that sees the cells around it and its neighbours' headings and decides which way to move and whether to settle. A thousand small decisions turn a random scatter into a word or an uploaded picture; the maker puts a word at about fifteen seconds and seven cents.
A Chrome extension that hides spam and noise in X posts and replies by combining Jev's probabilities for rules you write in plain language with local signals, and decides locally what to hide. Everything hidden can be restored in place, and if the API fails, posts are shown.
Write test steps as plain-English Gherkin and Jev picks the element, action and check for each one from options Decisium reads off the page; code, not the model, decides whether a step passed. Resolved steps are recorded so CI can replay them with no model calls.
A desktop app that finds and downloads decision-model GGUFs from Hugging Face, runs them on llama.cpp, and serves a local API with choice, yes/no and score questions, plus a playground for trying presets.
A Claude Code Stop hook with a local fine-tune of DecisionTune 1.0 that can block a turn ending that hands work back to the user. VENDOR-REPORTED on 864 test turn ends: the moderate setting caught 67.5% (195 of 289) of hand-backs at 15.8% false interventions, against 56.7% and 14.6% for phrase rules. That test split guided development. Both members were correct in only 16% (37 of 229) of synthetic pairs; the model did not beat phrase rules there. Warm model latency was a median 27 ms on an M5 Pro. The hook cannot verify claimed task completion.
Labels spreadsheet text locally with Laya and exports answers, confidence values and review flags. On 300 texts per dataset, the author reports 93% English news-topic accuracy, 68% Portuguese review sentiment accuracy and 33% exact star-rating accuracy. The review labels come from customer ratings, which can disagree with the text.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
A Chrome extension that asks Jev to sort Hacker News comments into reader-defined buckets, retaining the parent comment as context. The author’s demo records a 131-comment thread being classified and sorted. Six requests run concurrently, and an Other bucket catches comments outside the chosen categories. The recording shows the workflow; it does not measure label accuracy.
Licence, integration code and author-recorded demo checked 6 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Recorded demo →
Moves llama.cpp decision serving code into a C library. Its recorded d1 request takes 678 ms on eight CPU threads. Saved CLI/server parity tests stay within 0.01 for Laya, exceed that probability tolerance for H2O and Clef, and reject the tested Perplexity package. On a Pixel 8a in Termux, the maker reports a 464 ms yes/no decision with d1-2B Q4_K_M on four threads and 2.1 GB RSS. Without repacking, that question takes 1,210 ms at 1.1 GB RSS. iOS and Capacitor app bindings remain plans.
Source: Licence → Source: Saved parity output → Source: Phone measurement and build notes →
A macOS app whose browser agent makes every choice, such as which element to click, as one classification by Nimble-9B running locally in Ollama. Low-confidence calls go to the person.
Routes support messages through regex, then a small classifier, then decision models, then an LLM as a last resort, all running locally. Laya answers the guardrail and department questions, and Tev1 is the default for the next tier.
A one-file browser Pacman where the open directions at each step become the options in a single question to a local Tev1 model through Ollama's decision endpoint.
A proof of concept that classifies incoming requests with the Decisions API preview and hands them to worker agents. Its README warns that the preview's request format is not yet published.
A TypeScript library where Jev picks the table, columns, filter, order and limit from what the schema offers, so it can choose a column but never write a query. Drizzle, Prisma or a SQL builder turns the plan into a real, parameterised query.
A 3D boxing game where Jev, GPT-4o-mini and Claude Haiku pick each move from the same state and legal actions, and a seeded rules engine resolves the hits. The maker calls the 56-bout results a pilot, not a ranking.
Tags each pet product's species, life stage and allergens from the store's own text, asking Jev or Laya one typed question per value: supported, contradicted, unknown or conflicting, with the source sentence attached. Merchants can approve, correct and lock tags, or let a validated policy accept them automatically. A hackathon entry for AIBoomi Startup Weekend Kochi, 23-24 Oct.
A GitHub Actions job where Jev scores each new paper from your chosen arXiv categories against each of your research interests, code ranks them and keeps the top few, and only those go to DeepSeek for a summary emailed to you. The default follows humanoid robotics papers.
Ask a question and Jev, via Vercel AI Gateway, gives each of 100 well-known American politicians a yes/no probability; the faces above the threshold float up out of a physics pile.
A macOS app that transcribes both sides of a call on your Mac with Whisper while Jev ticks off each of your questions once it has been answered, notes which question you just asked, and flags surprising answers for a follow-up. The maker puts Jev's cost at about 1 to 2 US cents for a 45-minute interview.
Answers a seven-year-old's spoken questions from one scanned Grade 2 textbook chapter. Jev decides whether each new question can be answered from the chapter and, with the optional verifier on, whether the drafted answer's claims are supported by the retrieved passages; common questions are matched to cached answers. On the maker's 14-question test, the decisions API cut average answer time from 4.1 to 1.7 seconds and the cost of each gate call about 25 times, against the chat wrapper.
Paste a job ad and watch Jev walk Singapore's 2024 occupation classification level by level, keeping the three best paths at each step, to a five-digit code, drawn as an animated pixel-art crowd. Six requests, about 1.4 seconds, per the README.
Speak several instructions in one run-on sentence and Jev picks each action from a menu of skills, and any app from those installed on your Mac, while you are still talking. Anything outside the menu goes to Claude for a proposed shell command, which waits for your approval unless you turn on trust mode.
A Thunderbird extension that tags your email with decision models served by Ollama's /v1/systemone endpoint, such as Tev1 0.8B, Tev1 4B or Nimble, and keeps learning from the tags you add by hand.
An MCP server that gives an AI assistant yes/no, choice and score tools backed by whichever decision model you configure: any /v1/systemone endpoint such as Jev or Clef, or Laya running on Apple silicon. Its tools never name a model family.
A pixel-art village in the browser where Jev, via OpenRouter, chooses what each adult does for the next two hours, while fixed rules handle urgent needs, night-time sleep and children. The maker built it to test whether Jev's choices stay sensible and reflect each villager's personality.
Describe a side project and get BUILD, MAYBE or DON'T BUILD with the reasons: Jev rates pain, reach and feasibility out of five and judges whether the GitHub and Hacker News results it finds already do the job. A run costs well under a cent.
A DuckDB function that asks Jev typed questions about each database column: is it personal data, which kind, and whether GDPR, CCPA-CPRA, HIPAA, LGPD, PIPEDA or DPDP apply. Whether to keep, mask, hash or drop it is decided by code, not the model, and a failed call sends the column to review. Also runs in the browser.
Grades search results with Jev on a four-level scale, checked first against Amazon's human-graded shopping queries, and stores runs, results and judgments in DuckDB with the metrics computed in SQL. The author recommends checking it against at least 300 of your own labelled pairs before trusting it on another domain.
A Hugging Face app built on the R package decisions: upload a set of images or texts, ask Jev one question about each, and get every answer with its probabilities plus the R code to repeat the run. Visitors need no key or account; runs are checked against estimated session and daily budgets.
An Android app that can use Jev to sort notifications into five classes, from action required to hide, alongside local safety rules and corrections it learns from you. It starts in observation mode and never cancels notifications there; Jev is opt-in with your own key.
A public monitor of the West Philippine Sea with live ship positions, Sentinel-1 radar passes and Global Fishing Watch events. Jev answers four questions about each item from 13 news feeds, and two of them, whether it serves a Philippine reader and whether it carries PRC state framing, decide whether it is shown or held back. Live at wps.gdgt.link.
Jev, SAP-RPT-1, LLMs and a 15-line heuristic play Tetris on the same pieces and candidate moves, with live cost tracking. In the maker's 50-piece race Jev and the heuristic both cleared 19 lines and the others 18, a tie within noise; the difference was speed and cost.
Calls Jev, OpenAI's Decisions API, Upstage Solar Decide and local Ollama models through one interface and logs version, latency, tokens and cost. On picking the right one of 12 tools for 40 Korean and English requests, the maker measured Jev 1.13 at 40 of 40 and OpenAI Decisions at 0.90, against 0.85 for a generative model choosing directly.
A Chrome extension that splits the terms of service on the page into clauses and has Jev check each for eight kinds of one-sided term, from selling your data to forced arbitration, marking only clauses that go well beyond what major services do and showing each next to the original text. The maker says it is not legal advice.
Jev reads each failed test and decides the cause: environment or timeout, flaky assertion, genuine regression or API contract mismatch. Code re-runs the build only when every failure would be fixed by re-running (three attempts in all by default), gives flaky tests a low-priority ticket as well, and files tickets for real failures with the test's owner.
A Go command-line tool and MCP server that gives coding agents and shell scripts Jev's yes/no, choice, score and multi-question calls, with offline request previews and batch runs.
Visitors type what they need in their own words and Jev, via OpenRouter, picks the one page on the site that fits, choosing only from your list of pages. With no key or a slow reply it falls back to word matching.
Matches messy restaurant orders such as "2 cs portobellos, 5# limes" to exact catalogue items with Jev and flags uncertain lines for a person to check. The maker reports 96% exact matches on held-out test orders.
Sorts incoming mail for the maddy mail server into IMAP folders: Jev answers questions such as whether a message is spam or phishing, and rules in a config file turn the answers into a folder. It also learns from where you have filed mail before.
Reads Intune compliance data from Microsoft Graph, groups failing devices by the setting that fails, and ranks fixes by how many devices each makes fully compliant. For custom settings its rules don't cover, Jev can optionally pick the remediation path. You can try a live demo with a sample tenant.
A browser extension that asks Jev about every ad on the Bazoš classifieds site against criteria you write in plain language, and collapses the ones that don't match. Other marketplaces and auction sites are planned.
A small command-line tool that asks Jev to flip a coin N times and reports the share of heads.
Polls new Hacker News stories every two minutes, runs each unprocessed one through decision trees of Jev questions you define, and sends the stories that match any tree to a Telegram chat or channel.
An opencode plugin for autonomous runs: when the agent stops to ask the human a question, Jev (or an LLM, if you set one; the default tries Jev first) picks from the offered options. Below a configurable confidence (0.6 by default) it gathers context in a side session and decides again; below 0.35 the human answers after all.
A Pi extension that keeps most tool and skill descriptions out of the first request and loads them on demand. In its optional Jev mode, Jev decides before each prompt which ones the request needs.
An open research essay on three competitive 2026 US Senate races: compare stored Jev forecasts across different sets of evidence and different orderings of candidates and sources, with the exact requests and saved responses to inspect. The author calls it an experiment, not a calibrated forecast.
A Claude Code plugin that checks an agent's tool calls before they run, using hosted Jev when you configure a key and offline rules otherwise. In enforce mode it refuses a call with a reason; advisory mode only reports the verdict.
A free guide, a Claude skill and four editable recipes for typed marketing-ops decisions: route this lead, tag this asset, is this reply interested. Jev makes the call; an LLM still writes the copy.
A Chrome extension: describe what you don't want to see in plain words, and eligible posts on your X timeline get a probability per rule. By default, anything over your threshold folds into a one-line bar you can open again.
A small ticket router: with the Laya backend selected, each support ticket goes to Laya, the open Jev-style model, with three questions (which team, how urgent, is it spam). The default backend is a keyword stub, with a slot left for Jev.
A small demo with a live site: type a US or Indian stock and two Parallel Decisions calls, through Parallel's free MCP endpoint, assess its technicals and trading activity from the live web and return probabilities and sources.
Keeps the 50 busiest Polymarket questions forecast by several models, including Jev, Perplexity's Decider and an OpenAI model, all given filtered web search results but never the price. When markets resolve, each is scored on a leaderboard by Brier score, log loss and accuracy.
Give Jev a mission and some links: it gathers every item, judges each one live with counters and a running API bill on screen, and ends with a results page you can sort, spot-check and export. Runs on your own machine with your own keys.
A script that asks true/false and multiple-choice questions about an image, PDF, Word file, slide deck, spreadsheet or text, using a decision model on local Ollama. Validated with d1:3b and Clef-Flash; d1:3b is the default.
A Windows disk-space map that draws your drive as a 3D city and asks Jev which folders look safe to delete; those get a neon outline and land in a Reclaimable list, biggest first.
A step-by-step guide for people who don't write code: set up Jev with Claude Code and build a read-only assistant that ranks the last two weeks of Gmail into piles like Reply needed, Waiting on them and Possible phishing.
Simulates a moderation queue hit by a wave of privacy-invading posts the existing router did not prioritise: Claude reads 20 of those posts and 20 ordinary ones and drafts one yes/no question, and a fine-tuned version of the open decision model Laya asks it of every new post so the matches jump to the urgent queue.
Nace's DuckDB extension asks typed questions about rows from SQL and returns probabilities as column values, for routing support tickets, classifying documents or scoring data you already query. Nace also publishes MIT-licensed connectors for Snowflake, PostgreSQL, ClickHouse and Apache Spark, including Databricks SQL. Text and JSON calls default to drex-v2.0; images need an image-capable model such as drex-max.
Source: Snowflake → Source: PostgreSQL → Source: ClickHouse → Source: Apache Spark and Databricks SQL →
A ComfyUI workflow that adds you to an existing video. Liquid's d1-2B judges every shot (framing, whether there's room for one more person, where everyone stands) and casts the best ones, then image and video models put you in beside the people already there.
Written at Kariyer.net R&D to pull seniority, department and work type out of job ads. On 600 real ads with 7 questions each (4,200 decisions), Jev 1.13.0 scored 71.5% against 64.6% for the open tau-4b and 65.7% for a prompted 4B LLM. tau-4b was better calibrated (ECE 0.093 against 0.156), and it scored 95.7% on its own training data, which is why the author warns against benchmarking a model on the set it shipped with.
A harness that checks claims from earnings-call transcripts and footnotes against tables in DuckDB, on 64 synthetic cases. Perplexity's pplx-decider-flash-v1.2 scored 85.94% at about 1.4 s a case; a rule baseline scored 68.75% but caught only 2 of 9 Q&A deflections, which the decider caught 9 of 9. A chat model led on accuracy at 90.62%, with confidences stacked at 0.99 to 1.00. OpenRouter's chat endpoint rejected the decider with HTTP 400, so it runs through the separate /api/alpha/decisions endpoint.
jevgrep finds code by asking Jev thousands of yes/no questions. layagrep records those questions on SWE-bench tasks and fine-tunes the open Laya to answer them locally, with no API key and no code leaving the machine. A smoke run on 400 held-out questions lifted file-navigation AUC from 0.79 to 0.94 (Jev 0.97), but declaration relevance stayed at 0.58 (Jev 1.00).
Reads the probabilities of the answer tokens from one forward pass of an ordinary local LLM, with no fine-tuning, and serves them through a CLI, batch mode and a Jev-like API on Apple Silicon. On the 231 public JevBench questions, gemma-4-26b-a4b scored 84.8% at about 170 ms a question and ling-3.0-tiny 69.7% at about 45 ms; most of the misses are on the hard set.
A lab notebook for speeding up one decision model, H2O Lightning 4B, served through llama.cpp on an RTX 3060 Ti. Each request takes 2.13 to 2.45 times its roofline floor. The first measured change, a llama.cpp pull request, cut latency by 1.94% with bit-for-bit identical answers; the bigger gains in its list of 15 targets are labelled predictions.
An AstrBot plugin that decides whether a bot in a group chat should reply. It merges bursts of messages, separates conversation threads, then asks Jev four questions, batched into one request when the backend supports it (was the bot addressed, does it follow, should it reply, how urgent). For messages without a direct mention, quote-reply or poke, it uses a high and a low reply threshold alongside other checks, and scores in between can be reassessed later; those direct interactions can skip the gate. The README suggests a 3 to 7 day dry run first.
A Claude Code plugin that asks Jev one choice question per message, low, medium or high effort, and applies the answer when Jev is at least 60% sure. It changes effort, never the model, so the prompt cache survives. Subagents are never routed.
An agent runtime where an LLM reads the task, one Jev call answers four typed questions (next action, risk, whether to confirm, whether to reason further) and a local policy engine decides what may run. On 53 versioned test cases it hit the expected action 92.5% of the time against 96.2% for an LLM baseline, at about 1.0 s against 4.0 s, and asked for confirmation on 16 of the 17 cases that needed it.
An eval harness for agent skills: headless agent runs, code checks, Jev judge packs and blind human review; the generic pack asks one yes/no question per skill rule. Graded with the writing pack, the reference skill's v2 run matched its original benchmark's report within 2 points on every layer and in total.
Uses Liquid's open d1-2B as a local System 1 for DeepSeek Harness Browser Use and macOS Computer Use, with approvals and routing. Downscaling wide screenshots before the model reads them cut one decision from 879 ms to 310 ms on a 2508-pixel window, and six consecutive trials all chose a click action. d1-2B itself is under the LFM Open License, not MIT.
Retrieval that walks a document's table of contents, asking Jev one yes/no question per section, then ranks the sections it kept with EmbeddingGemma. On all 6,005 test queries of the public SearchTome release it returned 89.1% of gold sections at 3.6 sections per query, against 84.5% at 3 for EmbeddingGemma alone; its top-1 and top-3 recall equal the embedding model's. Jev alone, ranking flat, scored 54.2 top-1. It needs no training and runs on one 8GB consumer GPU, and failed upgrades are published too.
A course project where Jev chooses the transfer strategy for a CRANE+ arm in a Gazebo simulation, MoveIt 2 plans the path and ROS 2 controllers run it. In three episodes on authenticated Jev decisions with no fallback, Jev picked the home transfer at 0.94 to 0.96 confidence and all three placed the cube, 2.70 to 7.48 mm off target. These are scripted-teacher episodes; the README's separate learned-policy (ACT) tests are not reported as grasp success.
Drives an Android emulator from plain language: DeepSeek V4.1 Flash decides the next step, and Jev triages each screen (loading, error, permission prompt) and guards actions before they run. The three-step demo in the README, Settings to Network to Wi-Fi, cost $0.00019 and took 21 seconds; every step saves its screen, decision, tokens and cost.
Asks Jev one question per message, 300 to 600 input tokens, to tell whether the conversation is on the same topic, a subtopic or a new one, and recommends a session reset only when a new topic wins clearly (p of at least 0.65 and 0.25 ahead), so you stop paying to resend a dead transcript. Checked against live Jev on related, unrelated and short messages.
A desktop notes app for Mac, Windows and Linux that keeps plain Markdown files and runs the open Laya model on your own computer. Each tag is a yes/no question, like "Is this note about a trip?"; Laya answers all of them for a note in one pass and keeps the tags it is confident about. Notes stay on the computer; the only network request is a one-time download of about 1.6 GB of model files.
Lets the Pi coding agent drive real Linux desktop apps on Omarchy (Hyprland Wayland) by reading the accessibility tree and asking Jev for the target element and the operation. It offers 11 Wayland-safe element operations. Jev-driven actions abstain below 0.55 confidence and need confirmation below 0.70, or 0.90 for destructive ones; direct operations on a known element run without Jev.
Asks Jev 200 yes/no questions about one text in a single call and shows the answers as a heatmap. The keyless hosted demo replays recorded answers. VENDOR-REPORTED: about 185 ms for one question, 200 ms for 50, and 150 to 300 ms for 200; seven parallel calls returned 1,400 answers in 282 ms, against 1,092 ms back to back. The author measured Jev 1.14 from a US home connection and has not measured calibration.
An OpenAI-compatible router that filters models by hard constraints before Jev judges which one fits. VENDOR-REPORTED, on its own 30 prompts: tier accuracy was 100% against 53.3% for a heuristic, task-type accuracy 83.3% against 46.7%, and hard prompts sent to a weak model 0 against 14. Estimated savings against always using the strongest model, from token counts and configured prices rather than running the chosen models, were 35.6% against 68.7%; the heuristic's estimate was higher because it under-routed. Decision latency was 295 ms at p50 and 409 ms at p95.
Runs multilingual Laya through a local Go/ONNX service, with a ZCode plugin for risk checks, context selection and 13 MCP tools. VENDOR-REPORTED on an RTX 3060, three runs per variant: total input fell from 359,085 to 239,544 tokens (33.3%) and requests from 16 to 9, but non-cached input rose 21.8%. Laya ranking alone cut total input 9.3% and non-cached input about 2.8%, within the observed range; the author has not established a fresh-token or cost saving. The /decide endpoint took about 26 ms at p50.
Puts open pull requests on a wall and asks Jev eight typed questions about each diff and its tests, using quarkusio/quarkus by default. It keeps the answers separate and never combines them into a score. Right/Wrong feedback records corrections and groups accuracy by confidence as you label answers; no accuracy figures are published yet. Its questions and Quarkus context are adapted from brunobat/quarkus-pr-wall.
Supplies OpenClaw with local typed decisions from LiquidAI/d1-Omni-2B-MLX-8bit on Apple Silicon. It has a native decision provider and a bridge for OpenClaw's TypeSafe integration. The repository name contains Kev, but the runner loads d1-Omni. VENDOR-REPORTED on an M4 Mac mini: about 200 ms per warm batch and about 3 GB of resident RAM.
A scorer for the UK AI Security Institute's Inspect framework that asks Drex whether an output meets your criteria and keeps the probabilities, so you can change pass thresholds after the run. It defaults to drex-max, whose target changes with flagship releases; pin a model for repeatable runs. Drex Max accepts images, while drex-v2.0 accepts text and JSON.
Filters the For you and Following feeds in Chrome or Edge using a plain-language instruction and Jev. It sends one bulk TypeSafe request per timeline response, splitting to stay within input budgets, and removes posts scoring at least 0.90 before X renders them. Errors and timeouts leave posts visible; it checks at most 80 posts per response. The built extension has Chromium tests with X and TypeSafe responses stubbed. No filtering-accuracy figures are published.
Jev sizes a Copilot message as tiny, everyday, large or hardest and sends it to a helper agent pinned to a model. Defaults are Haiku 5.5, Sonnet 5.5 and Opus 5.5, with the hardest helper configured to request high effort. Recorded helper runs used medium effort. The author records live runs of the hook in Copilot CLI 1.0.105 and VS Code 1.144, plus the CLI wrapper. The MCP fallback is tested offline only. Its 54 offline tests passed when checked on 03 Nov 2026; it publishes no savings benchmark.
Clef scores tiles from Jamen Percy's 2026 Burning Man gigapan, then the code sums expected RV counts, car counts and shade coverage. The author's 256 px run judged 8,785 tiles for $5.29, estimating 14,385 RVs, 18,084 cars and 256.8 acres of shade. These are estimates: vehicles under shade are hidden, and dense 512 px tiles undercount. Splitting validation tiles into 256 px quadrants brought RV estimates to 386 against 394 from the LLM counters.
Author's recorded runs · VENDOR-REPORTED
A DeepSeek Harness plugin uses vLLM-SR d3-ultra to triage steps, guard tool calls, strip injected lines and check whether work is done. This is the model maker's integration, by Xunzhuo Liu, co-founder of vLLM Semantic Router. In his small probes, the guard got 35 of 36 commands right, stopping all 16 risky ones, and the shield got 22 of 22 passages right. He reports a 0.49 s median across 53 guard decisions. Triage of 230 tickets took 121 s and 117,877 LLM prompt tokens, against 543 s and at least 510,986 for the LLM alone.
Author's recorded runs · VENDOR-REPORTED
Incoming Gmail goes through Jev triage before alerts reach Telegram or Lark. Claude or Codex CLI can draft replies, which wait for a Send tap. One Python process uses one SQLite file. The author's testing notes record real Jev calls on nine synthetic emails at about 0.1 s each, plus an end-to-end run with real Gmail, Telegram, Jev and Codex CLI; they report no triage accuracy figure.
Author's recorded runs · VENDOR-REPORTED
A coding harness lets a worker propose state transitions and a judge approve, reject or redirect them. Its 02 Nov 2026 real-model run used Jev 1.14 as judge and deepseek-v4-pro as worker. The author reports five judge calls for under $0.0003; the allowed-choice menu corrected three requests for nonexistent states. A separate five-task SWE-bench pilot does not identify its judge, so its score cannot be attributed to Jev.
Author's recorded runs · VENDOR-REPORTED
In this local field test, Jev picks a unit's action from legal option IDs supplied by a tactics game's rules engine. The server checks the choice; a deterministic fallback handles late, malformed or weak replies. The author estimates about 75% lower token cost for those decisions with no obvious loss of tactical ability. Those are early playtest impressions. The first matches set both confidence and margin gates to zero, letting every legal Jev choice play.
Author's recorded runs · VENDOR-REPORTED
A local laya-multilingual fine-tune labels 9,696 Bilibili comments about Phantom Blade Zero with 14 questions and a two-level topic tree. The author reports 60.8 minutes of training on an RTX 3060. On 771 test comments with 1,485 decisions, topic accuracy rises from 0.210 to 0.911 and validity from 0.253 to 0.971. Test labels come from rules, whose topic precision is estimated at 72% to 75%, so 0.911 measures agreement with the rules. The README also discloses some train/test overlap. Toxicity detection fails at macro-F1 0.489, with only 11 training positives.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
A GitHub Action asks Jev nine questions per issue in one request, then a decision table turns the probabilities into labels and priority tiers. Probabilities between 0.3 and 0.7 count as unsure. It has a dry-run mode. The author's run passes 65 of 66 checks on 16 synthetic issues for about $0.001. That small synthetic set includes a fixture revised after its fake-example wording affected the answer.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
This Claude Code mod asks Jev through OpenRouter to grade the prompt being typed and name what it lacks. Hints are advisory; zero-data-retention routing is on by default. On 84 prompts, the band agrees with labels 71% of the time against an 80% target. Across 217 prompts with known outcomes, hints appeared on 25; 24% of those were followed by trouble (95% interval 11% to 43%), against a 10% overall rate. AUC is 0.60. Three blind Claude labellers supplied the labels. The harness is private, and whether the hints improve prompts has not been shown.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Scans three Laya checkpoints for answers that ignore the state, option-order changes and negation failures. In the author's 04 Nov scan, 5 of 984 instructions collapse on English Laya, 5 on typed-decisions and 35 on multilingual. On a 216-answer realistic guardrail panel, 16, 6 and 42 answers respectively are wrong at confidence of at least 0.9. The panel uses six texts per word, and some scan questions are semantically odd. Results identify cases to check, rather than an overall model ranking.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Runs Laya locally in a browser through ONNX Runtime Web, using WASM on CPU by default. The author reports 97.9% top-answer agreement with PyTorch across 48 questions for each quantized build. In Chromium, the default q8e8 build matches 11 of 12 top answers. A separate synthetic 108-case test of the original PyTorch model gets 59.3% of 312 answers right; that measures model behaviour, not browser parity. Quantized confidence values are approximate because calibration used the full-precision model.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Source: Synthetic test and limits → Source: Apache-2.0 licence →
Stores versioned decisions in Postgres and checks calibration against the user's labels. The author's Phase 0 run used Jev 1.13 on 2,000 consumer complaints for about $0.30. Top answers changed on 4.8% of rows across three identical runs, and on about 16.5% when the same rows were rebatched. The repository includes measured Phase 1 ledger and routing runs but has no published release. Its claims about managed hosts have not been tested on Supabase, Neon or RDS themselves.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Decision models choose one of 35 tilt-and-throttle manoeuvres on the same seeded lunar-lander courses. The game waits for the answer, so measured latency never changes the flight score. Across 160 levels per lane, the author reports 159 landings for a scripted autopilot, 156 for Jev, 151 for Kev-27B and 142 for the Laya fine-tune. Prompt selection and Laya training are documented; these results cover this simulator, with recordings available for replay.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Source: Recorded benchmark → Source: Prompts and training → Source: Licence →
Visual-inspection demo and benchmark for Muse Glimmer 30B with logistic decision heads. The maker reports 90.2% defect accuracy on 866 held-out images from known MVTec AD products. Half of each product's test images trained the head. Code, prediction records and a separate zero-shot path are public; the dataset is restricted to research use. The 21 ms early-exit measurement uses a truncated benchmark, while the supplied server runs full depth.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Source: Benchmark report → Source: Runtime and benchmarks → Source: Licence →
Tests whether LLM-written weight edits or Python overrides repair Laya's routing of Banking77 messages into five departments. In a two-seed pilot, the best code-patch mean is 78.1% accuracy, against 76.9% for the best weight-edit mean at a different effort setting and 70.3% unedited. Test-selected fine-tuning reaches 75.0%. Budgets differ beyond label counts, and isolation relies on paths and log scans. Stored logs and summaries support the reported runs; saved edited weights are omitted.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Handles exact voice commands with patterns, then asks Jev to choose an action for natural phrasing; an LLM handles uncertain cases and writes text. The author reports 69 measured commands: patterns handle 54%, and Jev the other 46% at 116 ms median. All eight questions and comments return unknown and run nothing. Its automated tests use no network or real sign-ins.
Authors' published runs · VENDOR-REPORTED; not independently reproduced
Rules handle unsubscribe and automatic replies first; local Laya labels the rest, with uncertain messages sent to an LLM. The author reports 110 of 117 selected replies correct at a 0.80 threshold out of 182 real replies. Rules were written after reading that same set, and model-drafted labels remain under review. Fresh held-out performance is unknown.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
Tests Microsoft-Decision-1 and a frontier reasoning model as contract-review judges on 2,091 ContractNLI and 1,224 CUAD judgments. Decision-1 with rules scores 82.9% and 90.0% accuracy. It reads overlapping chunks while the frontier model reads whole documents; added rules and confidence definitions differ. This is one author’s field test.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
A Korean adaptation of layaForWorkflows, using the multilingual Laya checkpoint in the browser. It records model answers for 37 examples across seven workflows. At branch threshold 0.50, its replay routes 15 automatically, 17 to people and five to blocking. Wording was adjusted against these examples, so this is a demonstration set.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
Runs multilingual Laya and a multilingual MiniLM embedder in the browser on Korean fictional documents. Its Korean report gives 62.5% accuracy on 72 claims with the default two-option question and 28% final-outcome agreement on 32 routing questions. The retained English README describes upstream results, not these Korean runs.
Published author-run records, checked 5 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
A browser agent in Tern’s visible WebKit tab: Jev 1.14 judges steps and GLM-5.3-Flash supplies typed values. The author records nine successful runs across three Wikipedia tasks. Median times are 1.6, 3.4 and 1.8 seconds. The same tasks shaped several fixes; the browser-use comparison uses a different browser and model, so it does not isolate the decision model’s speed.
Published author-run records, checked 6 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published run →
A Korean browser adaptation of Laya Memory, using multilingual Laya and MiniLM to flag stale stored facts. On 62 hand-written cases, the author records 19.4% strict accuracy and 27.4% lenient accuracy with the default policy; it closes one of 22 stale facts and wrongly invalidates one standing fact. This sample also shaped the questions and thresholds. App-event pairs have not been recorded.
Published author-run records, checked 6 Nov 2026; not reproduced in this scan.
Source: Licence file → Source: Integration code → Source: Published Korean run → Source: Recorded answers →
A browser element picker tested on an M2 Pro with 16 GB RAM. The author records 94 correct element picks from 94 live-site decisions across five runs, while only 91 of 95 browser steps finish. Page and action failures explain the difference. The wider grounding comparison finds no significant accuracy difference after multiple-comparison correction. Raw runs and a demo are public.
Author-run records and source checked 7 Nov 2026; not rerun locally.
Source: Licence file → Source: Grounding and browser code → Source: Recorded live run → Source: Results and limits →
A Rust and ONNX HTTP server for typestrict decision models, with no model bundled in its image. A pinned TS-PRGuard download script checks file hashes; golden vectors record the browser reader’s real model outputs. HTTP tests check answer shapes and errors. The author’s Apple M5 strategy measurements compare latency, memory and throughput, not model accuracy.
Author-run records and source checked 7 Nov 2026; not rerun locally.
Source: Licence file → Source: HTTP implementation → Source: Pinned test-model download → Source: Recorded model outputs → Source: HTTP contract checks →
A game playtest pipeline with planning between runs, model tactic selection and a code executor. Its recorded 36-run campaign made 247 Jev decisions, with 17 random fallbacks. All runs were valid, but the rule player had better outcomes: it escaped in all six aggressive runs while Jev’s aggressive player did not move. Three seeds and 12-second runs make this an exploratory demo.
Author-run records and source checked 7 Nov 2026; not rerun locally.
Source: Licence file → Source: Recorded campaign → Source: Replay-verified demo →
A simulated factory gives Jev a menu of feasible actions and puts an independent safety gate before the virtual PLC. Stored real-model campaigns cover 1,260 shifts and 32,226 calls without API errors or fallbacks. Most plan-completion gain comes from the surrounding architecture; its deterministic planner matches the full system at lower operating loss. No real equipment is controlled.
Author-run simulation records, not a fresh reproduction. Confirmatory batches exclude mock runs and the standalone extra shift. The gain from adding Jev alone is not statistically significant.
Source: MIT licence → Source: Licence notice → Source: Jev client → Source: Stored runs →
Runs Laya through native MLX, WebGPU or a TypeScript CPU reference. The author records 756 of 756 matching top answers against Python across three checkpoints and four GPU configurations. This measures implementation agreement on 63 questions, without labelled task accuracy. Q4 changes one to five top answers per checkpoint on those questions.
Author-run parity and performance records on a fanless Apple M2. Matching top answers does not mean identical probabilities; sustained thermal throttling changes timing.
Source: MIT licence → Source: Agent code → Source: Parity and timing records → Source: Recorded Python outputs →
Training, inference and evaluation code for the medical-jev-4b adapter. The published GPU package check records 1,028 correct answers out of 1,514, with 100 over-limit questions counted wrong. Experimental tournament handling produces a different result, 1,050 correct.
Author-run records, not a fresh reproduction. The benchmark was reused during development; the original training file is lost and the public training pool is reconstructed. The model is uncalibrated and is not for clinical use or triage.
Source: GitHub → Source: Licence → Source: Inference code → Source: GPU package check → Source: Evaluation and limits →
Pinned BF16 Docker recipe for Kanana on one NVIDIA GB10. Published memory, HTTP latency and Korean-exam records include actual choice, noul and score responses. The maker measured up to 17.12 GiB additional unified system memory under standalone load. A final image rebuild did not repeat full GPU loading; earlier loader runs and live-server smoke results remain separate.
Source: Recipe licence → Source: Validation and scope → Source: Real three-type API response →
Versioned judgment specs with cached answers, human review, tests and a diff of decisions changed by a prompt edit. The bundled Jev command-guard result covers 38 commands and keeps a warning for a missed outside-project effect. Only its destruction question has gold labels; two other hazards do not. This is a catch-up project discovered through an in-window push.
Author-run output; not independently reproduced
Source: Code licence → Source: Server licence → Source: Jev integration → Source: Recorded test output →
Recomputes calibration and selective agreement from pinned, published WorkflowEvals outputs for nine models across four workflows. The saved results reproduce 36 headline scores. Its reference is a two-LLM probability consensus, not human truth; no fresh model is called. Case-level gates remain in-sample.
Author-run records; no fresh model inference reproduced
Source: Licence → Source: Results → Source: Dataset matching → Source: Metric implementation →
Three-label sentiment code and saved predictions for Jev, Clef and Clef-flash on eight European languages. The zero-shot report covers 12,970 test items. Its comparison with five LLMs uses published paper scores with a different prompt format, rather than fresh matched calls. Broader prepared datasets and tuning runs are separate from this reported scope.
Author-run records; no fresh model inference reproduced
Source: Licence → Source: Zero-shot report → Source: Saved score table → Source: Jev English predictions → Source: Inference code →
A Chrome extension with local Basal topic judgments, word and author rules, and MobileCLIP image matching. Its report records browser-model parity and end-to-end fixture and live-page checks on an M4 Pro. Text evaluations use synthetic English and Polish posts; image scene matching does not reliably identify people. Downloaded weights keep their own licences.
Author-run records; no fresh model inference reproduced
Source: Licence → Source: Run report → Source: Browser inference →
Deploys Strands Decider 2B hobson-v19 to a SageMaker real-time endpoint and connects it to Kiro Crew. The pinned manifest matches hobson-v19 provenance, including the adapter and head hashes. The maker reports 35 benchmark invocations with no errors on ml.m5.2xlarge in Mumbai: warm median 2,894 ms and p99 3,031 ms. These deployment measurements belong to hobson-v19, separate from the v1 three-run weight average. The default 1,000 ms client timeout needs raising. The endpoint was removed after the run. Source includes the serving shim, invocation check, benchmark and cleanup; this does not establish Bedrock availability.
Source: Licence → Source: Serving shim → Source: Pinned weight manifest → Source: hobson-v19 checkpoint provenance →
A Chromium extension that scores pages and sections with Jev, while a generative model writes summaries on demand. Its usefulnews component publishes a 24-article Jev/LLM comparison and preference-feedback examples from September; those records do not benchmark the current extension.
Maker's recorded runs · VENDOR-REPORTED; not independently reproduced
Tests OpenAI Decisions API on reduced web-page text, with plain-HTML and headless-browser views. The published rendered-page summary records 60/68 reviewed phishing pages detected at threshold 0.5 and 2/198 benign pages flagged. Review labels came from an AI assistant, and raw pages and per-site predictions are not public.
Maker's recorded runs · VENDOR-REPORTED; not independently reproduced
An OpenAI-client wrapper that sends closed structured questions to a decision model and falls back on low confidence or unsupported requests. Its saved notebook shows Jev/GPT routing and a local Kev/Ollama path. Shadow mode measures agreement with the slower model; that agreement is not ground-truth accuracy.
Maker's recorded runs · VENDOR-REPORTED; not independently reproduced
Local CPU inference through laya-ts and ONNX, exposed as MCP tools for typed text questions. The maker records a thank-you note changing urgency when options are reordered. Optional stability checks re-ask the question and flag flips; their scores are uncalibrated, and stable answers can still be wrong.
Author-run records; not independently reproduced
Source: Licence → Source: Model integration → Source: Real-model test path →
Selects transcript windows with text-only Laya-multilingual and deterministic features, then asks Ollama for titles and metadata. The maker records real Hindi/English Laya calls and a synthetic end-to-end render. Hook questions disagree on one clip. Live target-machine Whisper GPU and Ollama stages remain untested in that record.
Author-run records; not independently reproduced
Source: Licence → Source: Recorded execution and limits → Source: Laya integration →
Reviews call transcripts through closed-option Jev questions, with code measuring interruptions, copying evidence turns and calculating quality scores. The saved SQLite database records 120 artificial calls through OpenRouter. A simulated engine is the default; uncertain critical judgments go to review. These calls do not establish performance on real customers.
Author-run records; not independently reproduced
Source: Licence → Source: Jev adapter → Source: Saved call database → Source: Published report →
Compares frozen regex rules, Jev and GLiNER on four labels. The published reports record model calls and threshold tuning on a random split of a mixed-source question pool. The two “weeks” are not later production traffic; the higher round-2b result is post hoc. The score cache is not committed.
Author-run records; not independently reproduced
Source: Licence → Source: Run report → Source: Threshold and hybrid limits → Source: Model client →
Jev checks individual rubric cells, Gemini reviews uncertain cells, and graders confirm scores. Published raw calls cover 24 synthetic answers and 150 labelled cells. Ten cells go to human review; evidence lookup is billed separately. The small comparison does not establish an accuracy gain.
Author-run records; not independently reproduced
Source: Licence → Source: Recorded evaluation → Source: Jev adapter →
Uses a fine-tuned Laya ONNX classifier to find explicit knowledge or experience limits in Italian practice answers. A recorded synthetic HTTP/WebSocket turn uses the actual classifier and scripted LLMs. Interview decisions and evaluation remain separate; real-speech quality and physical Mac performance are still open.
Author-run records; not independently reproduced
Source: Licence → Source: Pilot and integration run → Source: Current acceptance limits →
ARM64 assembly inference for d1-2B Q4_K_M and its Q8_0 projector on a 4 GB Pi 4B. Source, manifests and 80 answers are public. Choice questions update 48 selected image positions; direct counts keep all 300. Same-input timing uses four Pi pairs per format; the complete reference accuracy run uses x86 llama.cpp.
Author-run records; not independently reproduced
Source: Licence → Source: Benchmark protocol and results → Source: Third-party terms → Source: Image-question helper →
A CLI and dashboard for preparing labelled examples, training decision heads, evaluating predictions and serving a System One endpoint. Its released Laya medical-document classifier includes a separate held-out test report. The toolkit’s RLCD recipe is its own implementation; it does not disclose TypeSafe’s training code.
Public trained weights and evaluation record; no fresh training run
Source: Licence → Source: Released model and report → Source: Held-out evaluation →
Evidence
Papers, leaderboards, head-to-head tests, a security test and a hands-on review, then a small test we ran ourselves.
The phishbench maker reports 60/68 reviewed phishing pages detected and 2/198 benign pages flagged by OpenAI Decisions API at threshold 0.5, using headless-rendered text from the reported URL. Feed labels alone give 77/126 detections. An AI assistant reviewed the labels; popular benign sites are an easy comparison group. Only aggregate scores are published, so the raw labels and predictions cannot be independently checked.
Nathan Wang · phishbench · 9 Nov 2026Source ↗Trustle's Jev IAM experiment found that showing only a role's 25 riskiest permissions pushed 84% of assignments to the highest risk level. It changed the input to include typical permissions and the overall access mix, and kept escalation/secrets as minimum levels in code. A later fit on 110 public Google Cloud roles raised held-out weighted agreement with its reference from 0.75 to 0.86. The article supplies no public raw predictions; this is an internal evaluation, not proof of safe access control.
Adam Guymon · Trustle · 30 Oct 2026; found through 10 Nov HNSource ↗Javier Marín reports ZeroPoint 53.6% and Strands Decider 2B v1 58.6% correct decisions across 900 matched cases, half without a correct option. Both arms use the same 0.9 confidence threshold. Confident wrong picks on no-answer cases are 7.8% and 0.0%. Among each model's correct decisions, including correct none decisions, 66.0% for ZeroPoint and 36.8% for Strands reach that threshold. The maker supplies saved outputs. CPU/GPU timings use different hardware, and ZeroPoint canonicalizes option order before scoring.
Javier Marín · ZeroPoint saved comparison · checked 10 Nov 2026Source ↗Mohith Gajjela’s reanalysis of published WorkflowEvals outputs reports Jev ECE 0.029 on 11,110 categorical questions and 0.030 on the 10,954 questions all nine models answered. The reference is the mean of two LLMs’ probabilities, so these measure consensus agreement. Score questions are excluded from calibration tables; whole-case gates are in-sample. No fresh models were called.
Mohith Gajjela · WorkflowEvals calibration audit · 8 Nov 2026Source ↗The author reports zero-shot three-label sentiment macro-F1 of 61.7 for Jev, 54.1 for Clef and 48.5 for Clef-flash, averaged equally across eight European languages and 12,970 items. English Jev is 68.0. Five LLM comparisons come from Kastrati et al. (2026), with different prompt formats rather than newly matched calls. The saved predictions and score table are public.
Uran Lajci · zero-shot conference report · run 6 Nov 2026, discovered 9 NovSource ↗Artificial Analysis’s Decision Index v2 combines six evaluations and includes calibration in its Decision Score. AA-Paperclip carries 30% of the index and treats all 15 answers about a document as one decision; it uses 1,500 private documents. AA-Symmetry carries 15% and tests answer and probability consistency. The new tasks and scoring prevent direct comparison with v1 scores, JevBench or the Hugging Face index.
Artificial Analysis · Decision Index v2 · launch 8 Nov 2026 23:51 UTCSource ↗Hunch's stored Jev-1.13.0 test reports 0.9737 accuracy on destruction labels for 38 shell commands. Its 0.90 act rule accepts 22 of those judgments with no recorded errors. The other two hazard questions have no gold labels, and a pinned warning records a missed outside-project effect when stopping every bun process. This small bundled sample does not establish a production safety rate.
Mehmet Öner Yalçın · Hunch bundled test output · catch-up discovery 9 Nov 2026Source ↗The d1-2B RAG Verifier maker reports F1 81.5 and AUROC 0.936 on 2,700 RAGTruth responses, against base F1 70.9. Checkpoint and threshold were chosen on document-grouped development data. The fine-tune runs BF16 while the base comparison uses Q8_0 llama.cpp, so this is not a precision-matched training ablation. The reported 69% coverage at 95% accuracy is a test-set confidence curve, not a threshold guarantee for new answers. The source responses date to 2023; base-training overlap is unknown.
landtml · RAGTruth test predictions and model card · 8 Nov 2026Source ↗JevAlt and its Intern-Decision base both choose unknown in 9 of 11 held-out missing-fact cases. Fine-tuning raises the mean unknown probability from 0.55 to 0.74 in that small test, without improving the choice count. Deem-4B records 122/130 correct in a separate 4 Oct live check, including 10/10 missing-fact cases and 10/10 fact-present controls. The held-out decisions share the training-data pipeline.
Mert Kaya · Deem-4B card and recorded requests · October 2026, catch-up discovery 8 NovSource ↗One DGX Spark recipe records up to 17.12 GiB additional system memory for Kanana under standalone HTTP load, measured from the fall in MemAvailable. It retains 16.07 GiB after 30 seconds idle. Synthetic-image timings measure serving load, not vision accuracy; the single-request short-text mean is 0.038 seconds. Concurrent GLM tests use a particular 524,288-token setup and do not establish universal coexistence or a hardware minimum.
yangs1202 · Kanana DGX Spark raw runs and reports · 8 Nov 2026Source ↗Jevgrep reports 25.8% lower estimated combined task cost, $5.6564 against $7.6221, with 8/10 solves in both conditions. A later ten-task candidate cuts Jev cost about 59% but raises combined cost 2% to 3% against that saved cohort, with the same solve count. These are repeatedly studied Python tasks, one attempt per condition and reused baselines. Failed attempts count. Native costs use list prices; 19 later empty responses leave some usage unknown, bounded by the report rather than counted free. No general cost or speed gain follows.
David Zhang · Jevgrep total-cost records · 28 Sep 2026, catch-up discovery 8 NovSource ↗The Laya Minecraft maker reports accuracy moving from 0.9301 to 0.9325 and ECE from 0.0625 to 0.0435 on 415 decision items. Four overlap training or calibration. The agent filters valid actions before asking the model and verifies progress afterwards. These figures measure decision items, with no strictly held-out end-to-end gameplay result.
Thomas Tesche · Laya Minecraft card and training report · 7 Nov 2026Source ↗medgemma-decide-4b-v2 reports medline/adverse balanced accuracy rising from 0.625 to 0.825 after minority-class oversampling, above its 0.721 TF-IDF floor. Macro balanced accuracy across sources falls from 0.689 to 0.686; PubMedQA falls from 0.578 to 0.488 under the prior-adjusted decision rule. The maker evaluates 19,480 decisions in 15,320 records, one seed per run. These public text-label and exam tasks are not clinical validation; the model is research only.
Amaljith · medgemma-decide-4b-v2 card and results · 7 Nov 2026Source ↗Hightouch reports 98.8% accuracy at $0.88 per 1,000 synthetic identity checks when Jev sends 22% to Opus, against 99.0% and $3.86 for Opus alone. On its harder set, the cascade scores 95.3% at $2.94, versus 95.1% and $5.39 for Opus alone. The first set has 1,000 identities with half deliberately over-merged; thresholds were explored on that test. The article supplies neither uncertainty intervals nor a numeric calibration comparison. Its results do not establish production error rates on rare over-merges.
Albert Jin, Neil Desai and Delaney Mackenzie · Hightouch · 4 Nov 2026, shared on HN 6 NovSource ↗Across 210 simulated disruption scenarios at two load levels (420 pairs), the factory controller reports plan-completion gain 0.114 for the full system over ML detection plus fixed rules. Adding Jev alone gives 0.002, with a 95% interval from -0.021 to 0.031. Most gain comes from validation and safety controls; the deterministic planner matches the full system at lower operating loss. The stored confirmatory batches contain 1,260 real-Jev shifts and 32,226 calls. These results concern virtual equipment, not a deployed factory.
Minkyu Kim · Smart Factory AI Operations Center · public research release 7 Nov 2026Source ↗RASD Laya's maker reports accuracy 0.956 and macro-F1 0.903 on 23,358 test rows from held-out simulation runs. Training uses the same simulator and fixed text format. The rules baseline abstains as unknown when evidence is thin, which lowers its accuracy under this scoring. Unknown-class precision for the fine-tune is 0.571. No real-sensor validation is reported.
Galal Ban Amr · RASD Laya model card · 7 Nov 2026Source ↗In the author’s Laya-MLX browser study, correct element picks reached 94 of 94 recorded live decisions, but only 91 of 95 browser steps completed. On a separate 144-case comparison, no grounder’s accuracy difference survived multiple-comparison correction. The tested pages and candidate lists constrain transfer to other sites.
Who-Code / Keller · recorded browser study · 6 Nov 2026Source ↗The maker reports 95.4% agreement with Jev on 978 held-out Telegram messages at a 0.81 deletion gate, precision 0.82 and recall 0.70. The newest 15% is held out by time. This tests imitation of Jev labels; it supplies no independent human judgment of spam. The model does not inspect media contents.
Nikita Kolmogorov · Laya Telegram spam card · 6 Nov 2026Source ↗Ru-Jev’s author holds routing questions fixed and tests ten vocabularies with five candidates and eight with eighteen. The augmented release gains up to 0.24 accuracy on ordinary and borrowed words; abbreviations gain nothing useful, and opaque codes remain near chance on the strict slice. Eleven of fourteen gains survive Holm correction. With eighteen candidates, confident errors rise on jargon and slang. Each recipe has one training run; other data changes prevent attributing all differences to augmentation.
Beskorovainyi · arXiv 2611.08439 · 5 Nov 2026Source ↗In a 1,000-query test of forum-style pages with hidden instructions, attack pages are retrieved for 986 queries. The authors report automatically measured attack success of 27.9% with the baseline guard prompt, 13.6% with combined mitigations and 5.7% with Kev added. It wrongly flags 4 of 186 benign instructional pages. A separate 200-query pollution experiment needs filtering before top-ten selection; filtering only those ten leaves too little evidence. The synthetic attacks and tested pipelines limit transfer to deployed systems.
Ghadamyari and Habibi · arXiv 2611.08325 · 5 Nov 2026Source ↗On 62 hand-written Korean memory/event cases, multilingual Laya’s default policy scores 19.4% strict and 27.4% lenient accuracy. It closes one of 22 stale facts and wrongly invalidates one standing fact. The event gate labels 39 of 62 inputs as commands and another 13 as questions or plans, bypassing most pair checks. Questions and thresholds were developed on this sample; the English upstream results use a different checkpoint and runtime.
realizer-1966 · Korean Laya Memory recorded run · 5 Nov 2026Source ↗The author records nine successful Jev-tern runs across three Wikipedia tasks, with median wall times of 1.6, 3.4 and 1.8 seconds. Browser-use also succeeds nine times, using Chromium and GLM-5.3; Jev-tern uses WebKit, Jev 1.14 and GLM-5.3-Flash. The tasks prompted several fixes, including code that jumps to a uniquely named heading, so the reported speed gap combines models, browsers and task-specific code.
cyriusweng · Jev-tern benchmark and raw rows · 5 Nov 2026Source ↗TandemBench supplies global information and candidate team plans for 1,200 cooking-coordination questions, with references established through execution and exact search. The authors compare 40 native decision models with 10 general-purpose LLMs. The best native decision model reaches 62.50% plan-selection accuracy, while optimality verification remains near chance. Some models report better alternatives whether or not an optimal plan is already among the options. This tests plan selection and verification, not a live multi-agent deployment.
Li, Feng and Qin · arXiv 2611.05827 · 4 Nov 2026Source ↗Zuse’s author reports 87.5% accuracy for its 27B model across 27 languages, with pooled ECE 0.016 and source-weighted ECE 0.035. This is a development suite that also guided model selection, with one seed. Calibration gaps vary by task; a shared temperature cannot fix both overconfidence on knowledge questions and underconfidence on acceptability. English public-suite results trail Jev and Kev. The paper’s claim that no prior models reported outside English is not adopted here.
Umair Mehmood Imam · arXiv 2611.06238 · 4 Nov 2026Source ↗Across 9,000 humor, helpfulness and summarization items, the authors collect 702,000 judgments from Jev, Clef Flash and Perplexity Decider while changing presentation but preserving the evaluated texts. Jev’s second-position probability advantage reaches 6.11 percentage points on summaries. Reversing reader endorsements changes Decider’s selected humor text on 40.40% of pairs. These are separate interventions and tasks; repeatability, presentation robustness and agreement with people are different checks.
Agrawal and Mamidi · arXiv 2611.06384 · 4 Nov 2026Source ↗Airbnb reports a Gemma4-E2B fine-tune reaching max F1 0.902 from 0.563 on a 10,000-example weighted production-policy set, at 35 ms median gateway latency. Its public-model serving uses one RTX Pro 6000. Scores use the best threshold for models returning probabilities, while generative APIs supply one verdict. The cost comparison uses October list rates and an assumed 71% cache hit rate; the roughly 1% cost result depends on high request volume. This is Airbnb’s task and infrastructure, not a universal hosting break-even.
Gibson and Elmalaha · Airbnb Engineering · checked 5 Nov 2026Source ↗LUAR tests Laya on 300 texts per dataset on a Windows laptop with integrated graphics and 16 GB RAM. The author reports 93% English AG News accuracy; Portuguese B2W review results are 70% recommendation, 68% sentiment and 33% exact star rating. With confidence at least 0.7, topic accuracy is 98% on 84% of news rows, versus 72% to 75% on selected review rows. Review labels are customer ratings and may not match the written text.
HayateV30 · LUAR recorded evaluation · 4 Nov 2026Source ↗In a browser run on 72 claims about 18 fictional Korean documents, multilingual Laya scores 62.5% accuracy and 0.62 AUROC with two options; yes/no scores 65.3% and 0.67. Three options lower the false-verification rate from 36.1% to 11.1%, while accuracy falls to 58.3%. Its separate 32-question router reaches only 28% final-outcome agreement. These are a small demo’s recorded runs, not a general Korean-language benchmark.
YongSoo Park · Korean Laya RAG report · 5 Nov 2026Source ↗On 2,091 ContractNLI judgments, the author reports Microsoft-Decision-1 with legal rules at 82.9% accuracy versus 79.1% for medium-reasoning gpt-6-astra without rules. On 1,224 CUAD judgments the figures are 90.0% and 88.0%. Decision-1 chunks documents; the frontier reads whole contracts and supplies verbal confidence. A 0.90 cascade escalates 30% of ContractNLI judgments but touches every document, so judgment coverage is not document-call savings. This is one run, not a universal model ranking.
james-tn · contract-review judge field test · Nov 2026Source ↗On 2,000 consumer complaints, pgdocket's author repeated the same Jev 1.13 requests three times with identical options and batches. Probabilities match on 27.5% of rows; 95.2% keep the same top answer across all three, so 4.8% change. Rebatching the same rows changes about 16.5% of top answers. These are one author's dated API observations, not a measurement of every decision model or current Jev release.
ElyasEbrahim · pgdocket Phase 0 · 17 to 19 Oct 2026Source ↗Low Gate flies 20 seeded courses of eight levels per lane. Its author reports 156 of 160 landings for Jev, 151 for Kev-27B, 142 for a Laya fine-tune and 159 for the scripted autopilot. All lanes choose from 35 manoeuvres, and the game waits for every response. It measures this simulator's landing rate; response time cannot reduce a lane's score. Prompts and Laya training were selected separately from the scored courses.
Eren Terakye · Low Gate recorded benchmark · checked 5 Nov 2026Source ↗A two-seed Banking77 routing pilot reports Laya accuracy of 70.3% unedited, 78.1% with Opus 5.5 high-effort code patches, 76.9% with medium-effort weight edits and 75.0% for test-selected fine-tuning. Code patches have the highest mean in this pilot, while individual runs overlap. Editors get correction sentences and may embed extra messages or add architecture; budgets are matched only by labels. Some logs omit tool transcripts, leaving leakage unresolved for those runs.
demirelo · weight-edit-lab Laya pilot · 4 Nov 2026Source ↗Glimmer System One's maker reports AUROC 0.962 and 90.2% accuracy on 866 MVTec AD images held out from the same 15 products used for head training. Its layer-13 head reports 0.954 and 88.3%. The zero-shot path reports AUROC 0.882 with temperature fitted by leaving products out. The trained-head and zero-shot tests use different splits. VENDOR-REPORTED; not independently reproduced.
Aryan Srivastava · Glimmer System One heads card · 4 Nov 2026Source ↗A 04 Nov glassbox scan asks 984 yes/no instructions of each of three Laya checkpoints. It flags 5 English, 5 typed-decisions and 35 multilingual instructions as high-confidence answers that ignore the state and stay flat on a varied text panel. Changing option order changes 26 of 96 English choice answers. The author separates cue-insensitive answers from collapse after an early scanner over-counted them. Some probe questions are semantically odd; the realistic panel has only six texts per word.
code2saurabh · glassbox 0.1.0 · 4 Nov 2026Source ↗On AG News, low confidence ranks hijacked answers above clean ones on four of five systems at AUROC 0.86 to 0.90. At a threshold fitted to alarm on at most 5% of separate clean calibration articles, the three API-served systems still miss 51% to 70% of plain-note hijacks. Adding one handwritten sentence that asks for certainty raises misses to 99% to 100%. Ranking attacks and stopping them at a usable false-alarm rate are different tests.
Yao et al. · Ranked but Not Stopped · arXiv 2611.02522 · 2 Nov 2026Source ↗Nine model sizes from 0.8B to 32B are fine-tuned with one LoRA recipe across general decision and finance data. Narrow training costs 9 to 45 percentage points of general decision competence. On realized-return questions, every size stays near the horizon-conditioned prior at 0.37 to 0.38 accuracy under the study's controls. A mixed training corpus restores general decision performance while retaining policy answers and near-specialist calibration. This study finds no conditional return-prediction edge in its tested models.
Kumar · Honest Small Decision Models for Finance · arXiv 2611.03755 · 2 Nov 2026Source ↗JevBreak tests seven decision models on 240 text examples from 16 tasks, targeting 990 wrong-option outcomes per model. Its probability-guided Slot Attack succeeds on 32% to 99% of tested record and wrong-option pairs whose clean answer was correct, with a median 17 to 72 queries per successful attack. Attackers can force every available wrong option on about 20% of correct JEV decisions, 77% for gpt-6-luna and 98% for GLiNER2.5. Confidence thresholds do not reliably screen out these attacks.
Birur et al. · JevBreak · arXiv 2611.03759 · 2 Nov 2026Source ↗SLATE tests long sequences of API choices over an e-commerce library of about 1,000 tools. Its simulator grades whether every reference outcome is reached and accepts alternative valid paths. Across six open decision models and their language-model backbones, from 3B to 12B parameters, the best system completes 5.0% of tasks. These results concern whole multi-step tasks, not accuracy on a single tool choice.
Wei et al. · SLATE · arXiv 2611.03982 · 2 Nov 2026Source ↗OLIVIA freezes the analysis before unblinding a January to July 2026 stock-news test. A fine-tuned decision model's daily information coefficient falls from 0.055 and 0.065 on two validation quarters to 0.020 (t=1.7) on the blinded test. Three commercial models track the overnight move but not the return after the open. No pre-registered strategy survives costs and a deflated Sharpe ratio. The commercial models identify masked companies in 62% to 74% of cases, against a 28% baseline, so removing names does not remove identity clues.
Dehkordi et al. · Thinking Fast, Trading Late · arXiv 2611.03985 · 2 Nov 2026Source ↗On 30 fully synthetic clinical cases and 120 typed questions, adding structured memory raises Jev accuracy from 90.0% to 93.3%. Five answers improve and one worsens; exact McNemar p=0.219. Choice log loss falls from 0.258 to 0.175 and binary Brier score from 0.054 to 0.022. Memory adds 310 input tokens per call on average, with mean latency still about 0.5 seconds. Labels are one author's judgments and the memory is an oracle upper bound, not extracted production output. This pilot does not validate clinical use.
Sayani, Karwande, Bharadwaj · Structured Clinical Memory · arXiv 2611.04101 · 3 Nov 2026Source ↗A recruitment audit compares demographic changes in CV scores, rankings and shortlists against run-to-run variation on unchanged CVs. It finds small but measurable demographic effects for Jev, especially through implicit cues such as names. The bias set has 572 English CVs and 11 job descriptions across 11 occupations. Names follow US and UK conventions, with two names per group (four for Asian ethnicity) and binary gender. The controlled CV edits do not measure downstream hiring outcomes or certify fairness.
Ul Haq, Rigoni, Sperduti, Fabris · Fast, Cheap, and Fair? · arXiv 2611.04510 · 3 Nov 2026Source ↗Coroot replays 31 synthetic p99-latency scenarios minute by minute, with a three-minute hold before paging. Its burn-rate rule gets 30 of 31 right; Jev 1.13 tuned at 0.59 gets 29; Tev1-4B at 0.5 gets 28; untuned Jev and tuned Nimble 9B get 27. Explaining the hold raises Tev1-4B from 23 to 28. Coroot reports about $30 for two OpenRouter passes, including eight cents for Jev. Thresholds were tuned on these same scenarios, designed to be obvious to a human with a fixed 1 s SLO.
Coroot · Anomaly detection for alerting · 03 Nov 2026Source ↗On 2,319 GitHub issues with one human type label each, typesafe-cascade reports 76.7% accuracy for Jev 1.14 with no threshold. At 0.8 it keeps 1,964 issues at 81.9% accuracy; at 0.95 it keeps 1,689 at 85.2%. The 1,794 issues in the 0.9 to 1 confidence bucket average 98.9% confidence but only 84.3% accuracy. Excluding question labels gives 99.1% confidence and 91.7% accuracy in that bucket. The author suspects maintainers' resolved-issue labels add noise and would fix the label set before tuning the threshold. The sample is stratified by label, unlike a real backlog.
monumei · typesafe-cascade · Jev 1.14.0 results · 03 Nov 2026Source ↗A lowercase positive predicate makes the English Laya root checkpoint answer false at full confidence regardless of the state in code2saurabh's reproduction of issue #1244. Rank-1 edits to layers 16 to 21 use 12,288 learned numbers, a 54 KB patch fitted in about six minutes on a GTX 1650 Ti. On 872 SST-2 validation reviews, accuracy rises from 0.491 to 0.888 and AUROC from 0.496 to 0.940; wrong answers at confidence at least 0.9 fall from 443 to 13. Two held-out wordings score 0.858 and 0.890. The labels workaround still scores higher at 0.908. Only the English root checkpoint was tested; the negative wording stays near 0.62.
code2saurabh · Laya #1244 weight patch · English checkpoint 7b928d82, laya 0.4.21 · 03 Nov 2026Source ↗Across eleven judge benchmarks, Subramanian tests 14 decision models against generative judges. Five are statistically indistinguishable from GPT-5.6 without reasoning across all five pairwise and best-of-4 benchmarks. With a reference answer, eleven reach 90.3% to 93.4% on JudgeBench, statistically indistinguishable from Opus 5.5 and GPT-5.6 with reasoning. Injection reverses 0% to 5% of correct verdicts for five models, but 17% to 49% for the other nine. The figures are Subramanian's measurements.
Shreyas Subramanian · To Jev or Not to Jev · arXiv 2611.00505 · 31 Oct 2026Source ↗An English winner need not win elsewhere. XDecideBench covers nine suites, 122 languages, 88,425 texts and 153,875 typed questions. The English-best model, chosen in hindsight, loses significantly in 56 of 232 suite-language cells. A confidence threshold fitted on English for 5% errors admits 7.8% to 12.4% on German and French XNLI. These are Šuppa and Kopčan's measurements; thresholds need checking in the language and task where they will run.
Marek Šuppa, Jaroslav Kopčan · XDecideBench · arXiv 2611.01370 · 01 Nov 2026Source ↗Examples and counterexamples changed how policy gates behaved in agentapprove's study. James P. Beno tested 22 hosted decision models and two prompted general models on 2,643 synthetic tool calls labelled blind against 28 rules, with a sealed holdout. Explicit boundaries raised recall by 5.5 to 26.1 points on all 23 models still available and reduced false positives on 21. Jev 1.14's recall rose from 89.3% to 98.2%; unnecessary interruptions fell from 30.6% to 4.8% of 252 clean actions. With examples, its median latency was 120 ms at $0.46 per thousand requests. The author sells the policy engine.
James P. Beno, agentapprove · Decision Models as Policy Gates for Coding Agents · arXiv 2611.02155 · 01 Nov 2026Source ↗S1CogBench tests 24 cognitive tasks in 27 modes. Laya fails to beat uniform choice on 17 of 26 targets, against 3 for Intern-Decision-4B, which beats its Qwen3.5 backbone on 23. In Mouselab, Qwen earns the highest autonomous reward but predicts humans worse than uniform choice; Laya fits humans best among the open models yet earns zero reward. Under the same readout, Intern-Decision is no faster than its same-size backbone. Generating text takes 80 to 316 times as long as one forward pass in the two general models timed. Hou and Yamada report these results.
Dengzhe Hou, Kazunori D. Yamada · S1CogBench · arXiv 2611.00911 · 31 Oct 2026Source ↗At a fixed review budget, Cyber-JEV misses fewer vulnerable functions in its authors' test. An ensemble of five fine-tuned Qwen3.5-4B models reaches AUROC 0.814 on 7,270 functions, against 0.743 for Jev 1.13. With both limited to 4,031 alerts, it misses 16 of 322 vulnerable functions instead of 39. The method trains on matched vulnerable, patched and unchanged functions; the paper links no code.
Zhao et al. · Cyber-JEV · arXiv 2611.02957 · 02 Nov 2026Source ↗Parallel's PWS-Decisions averages three runs of 300 questions on 29 Oct 2026 (Pacific). Its API with live web search scored 76.22%; Perplexity Decider v1.2 scored 50.89%, OpenAI's Decisions API 41.67% and Jev 1.14 33.44% without web access or supplied external context. Parallel puts uniform random guessing at 42.42%. GPT-6 Luna and Claude Haiku 5.5 with native search scored 97.33% and 96.56%, at $16.52 and $27.43 to $28.79 per 1,000 questions, against Parallel's $1.00; median latency was 7.42 and 6.38 seconds against 0.56. Parallel generated synthetic questions from its own customer topics and search traffic, with separately researched answers and exact-match scoring; refusals count as wrong. It calls this a development challenge set: 100 questions are gated, 200 private, and questions, answers and per-question predictions cannot be redistributed. The runner is MIT. The blog chart labels Baseten Elephant at 32.4% overall and 32.3% public; the repo instead records Mammoth at 45.0% and 37.0%.
Parallel · PWS-Decisions v0.1.0-rc1 · blog, repository results and dataset terms · 01 Nov 2026Source ↗Adding Clef-Flash 9B as a domain router reduced pooled nDCG@10 from 0.4503 to 0.4084 in nicklisac's retrieval experiment. Per-domain LoRAs with the router reached 0.4923; a joint LoRA without it reached 0.4947. Perfect domain assignment to specialists gave an oracle ceiling of 0.4991. The detailed report and logs use 2,161 held-out queries over FiQA, ArguAna, SciFact and CQADupstack-gaming, with EmbeddingGemma 2 on one RTX 3090; the README says 1,081. Post-retrieval reranking and pruning with Clef-Flash also reduced the corresponding embedding-only scores.
nicklisac · lora-router-rag · REPORT.md and results/run_log.jsonl · checked 03 Nov 2026Source ↗Using Tev1's own decision protocol and v1 evaluation data through local Ollama, jev-rsi's author measured untuned Qwen3.5-4B at 673/1,000 (67.3%) on test and 130/300 (43.3%) on policy_transfer. Together reports 880/1,000 (88.0%) and 300/300 (100%) on evaluation sets used during development (VENDOR-REPORTED). In a separate frozen-backbone experiment with small heads and a fixed self-improvement loop, test scores ranged from 6.7% to 31.1%, against a 29.8% random baseline, on a small held-out set. The author concludes that heads alone did not learn the decision task in this setup.
Joshhuang123 · jev-rsi · baseline and frozen-head experiments · 02 Nov 2026Source ↗EO-Jev adapts d3-flash (8.4B, Qwen3.5-9B backbone), from the Decision 1.0 makers, with LoRA for Earth observation. Across 30 settings from 23 public benchmarks, its authors report significant improvements in 26 settings, averaging +23.8 accuracy points in-domain and +8.0 on 12 held-out settings. It matched or exceeded the best open EO specialist in 20 of 28 settings and had lower calibration error in 21 of 28. Median throughput was 6.4x the specialist's with each at its best batch size, or 3.2x with one question per call. General decision accuracy fell 1.8 points. Counting, change quantification and calibration far from the training data remain weak spots. The repository has code and reports; it excludes weights and run logs, and lists the paper as coming soon.
Abouelhadid, Abuhani, Munir, Khan, Khan · MBZUAI and collaborators · EO-Jev · 02 Nov 2026Source ↗With two reference images per class across five manufacturing case studies, Jev scored 0.75 to 1.00 test accuracy and Clef-Flash 0.71 to 0.99, against CLIP's 0.67 to 0.84 using the same references. The authors' agentic description refinement improved accuracy in six of eight model/application combinations, and their calibration reduced Brier score in 13 of 15 configurations.
Megahed, Chen · Beyond CLIP · arXiv 2610.41199 · 30 Oct 2026Source ↗VerdictAD uses Clef-Flash 9B to refine existing anomaly detectors with decisions about whole images and local regions. In the authors' four-shot tests, averaged over three reference draws, PatchCore's image AUROC rose from 93.0 to 97.5 on MVTec AD, 89.0 to 93.9 on VisA and 67.4 to 78.0 on MVTec LOCO AD. DINOv2-L rose from 68.7 to 77.5 on LOCO. These are image-level AUROC figures, not accuracy or pixel-level scores; the repository includes the paper and experiment logs.
Sun et al. · VerdictAD · code, paper and logs · 02 Nov 2026Source ↗One developer trained a decision head and LoRA on Qwen3.5-0.8B with Unsloth to screen job postings. On 63 receipt-labelled test examples, accuracy was 0.762 and macro-F1 0.683, against 0.714 and 0.278 for always rejecting. On a separate 460-posting check against an agent's historical verdicts, accuracy was 0.726, below the 0.835 always-reject baseline. That external check uses a different population and reference. The author's data and trained weights stay private, so a public clone cannot reproduce the scores.
jayvir-git · training-own-decisions-model · 02 Nov 2026Source ↗A medical LoRA on Qwen3.5-4B scored 67.90% on 1,514 external questions, against 59.91% for the base with the same scoring method and 70.87% for archived Jev 1.13. The full-set score counts 100 questions with 148 options as wrong because the released interface supports at most 52. On 100 triage questions it answered 40 correctly, against Jev's 66. The maker has not scored 1,620 sealed questions; training labels lack individual clinical-expert review and the probabilities are uncalibrated.
JuneYao · medical-jev-4b · model card · 02 Nov 2026Source ↗PathoJev encodes a pathology slide once and answers several questions over that shared visual context. Across three whole-slide benchmarks, the authors report mean accuracy of 77.2% for 9B and 78.1% for 27B, exceeding SlideChat by 5.4 and 6.3 percentage points. The 9B model ran 9.1 times faster than SlideChat on WSI-Bench. Against encoding the prefix separately, shared context was 6.9 times faster for eight questions and 11.2 times for 64 at 9B; the 27B figures were 5.9 and 8.9 times.
Zhang et al. · PathoJev · arXiv 2610.40752 · 29 Oct 2026Source ↗DecisionRank trains a decision reranker by having a generative teacher judge ranked lists built from the student's scores. The authors report that a 1.7B student beat its 27B generative teacher on TREC DL19 to DL23. At 8B, it beat its generative listwise counterpart while running 24.5 times faster on TREC DL and 16.7 times faster on BRIGHT.
Wu et al. · DecisionRank · arXiv 2610.42128 · 30 Oct 2026Source ↗Operon-S1 turns recurring judgments in a biomedical agent into closed questions at 13 decision points. A local decision model answered in-loop requests at a median 0.6 seconds on CPU, with no measurable agent-score change on five of six benchmarks. Asking the driving LLM those same questions instead accounted for 8.0% to 35.2% of task cost. Genoria AI's study spans seven life-science benchmarks overall; the unchanged-score comparison covers six, and task-level results use the public checkpoint.
Hou et al., Genoria AI · Operon-S1 · arXiv 2610.41350 · 30 Oct 2026Source ↗Liquid's open 2B decision models against two 2B chat models (Qwen3.5-2B, InternVL3.5-2B) on 248 real pictures, all on one RTX 5060 Ti. d1-2B routed scanned documents to one of 16 types at 88.8% against 55% and 56%; d1-Omni-2B classified 71 of 73 clear frames correctly as violent or not (97.3%); on a 50/50 defective-part set the d1 models scored 70.8%. d1 was 1.6 to 23 times faster per question. The author notes it is not quite like for like: the chat models reply in text. On 500 text items d1-2B agreed with Jev's answers 68% of the time.
Aditya (@0xironyAditya) · d1-2B vs three 2B models · 01 Nov 2026Source ↗Jev as a search reranker against Cohere, Voyage and Qwen rerankers on multilingual MIRACL and Japanese JQaRA. Scoring each passage with its own yes/no question, batched per query, Jev 1.14 scored nDCG@10 0.7496 on MIRACL and 0.8849 on Japanese JQaRA, the best mean of the final seven (0.8173, against 0.8061 for Cohere rerank-4-pro), at $0.89 to $1.14 per 1,000 queries against Cohere's $2.50. In a separate 252-query MIRACL run most dedicated rerankers beat Jev 1.13 by a significant margin; results differ by dataset, model version and scoring method.
Jeffrey (Dongkyu) Kim · jev-reranker · 01 Nov 2026Source ↗Decision models playing Super Mario Bros. world 1-1, one choice per step. From the game state, Perplexity's Decider v1.2 cleared the level in 20.13 game seconds for $0.0078, and Liquid's d1-ultra and Inception's Mercury Decide also cleared it. From pixels alone, Decider v1.2 and Baseten's Mammoth 1 cleared it; Jev 1.14's best pixel run reached 51.94% of the level. These are 46 development runs with different settings, which the author says are not a ranking.
Nicholas Greenwood · mario-bench · 01 Nov 2026Source ↗On the 127 test documents of the Text Anonymization Benchmark (European Court of Human Rights cases), Cloudflare's extraction model Clairic flagged more identities than OpenAI's Privacy Filter but was less precise: 77.7% of its spans were ones annotators marked to hide, against 93.4%. Passing each Clairic span to Jev to decide hide or keep raised precision to 91.1% while keeping Clairic's recall (96% on applicant names and case IDs, where Privacy Filter found 77% and 2.2%). It cost the most: $0.86 per 1,000 judgments against $0.26 and $0.17. Legal documents only.
Arjun Kumar, Clavia · Detecting private data using extraction + decision models · 31 Oct 2026Source ↗13 decision models against 15 generative LLM setups on 1,273 four-option MedQA questions. Decision models scored 67.71% to 89.08%, the generative setups 78.32% to 96.86%. Mercury Decide was cheapest at $0.0069 per 1,000 questions and Clef Omni fastest at a median 0.291 seconds. Answers given a probability of 0.90 or more were still wrong 1.71% to 12.77% of the time, depending on the model.
Freyer et al. · Decision models vs generative LLMs on medical questions · arXiv 2610.38448 · 28 Oct 2026Source ↗Jev and five open decision models on gender-swapped yes/no decisions about people, BBQ and StereoSet. Five of the six gave women significantly more favourable answers than men (+0.05 to +0.10 in log-odds), and swapping gender changed 1 to 3.5% of top answers. The makers' recommended confidence gate removed many biased answers but raised the stereotyped share of those it kept on ambiguous BBQ gender questions.
Havinga · When the Top Answer Decides · arXiv 2610.39747 · 29 Oct 2026Source ↗A team put Jev into a multi-agent build pipeline for Claude Code for 16 days, about 5,300 calls, as advisory checks, an on-demand tool and binding gates. It was accurate where the majority answer was enough and mixed elsewhere; 172 of 240 scope judgments came back uncertain or with insufficient evidence. On the claim-support gate, a strong model solved the task from the same excerpt, so the gap was Jev's. They removed it and never measured the token savings they were after. The anonymised data is published, with a script that rechecks 103 of the reported figures.
sash-ua · Accurate and Useless · 30 Oct 2026Source ↗Squigdle, a daily drawing game, sends every doodle to Jev as a 512×512 image plus its title and acts on the probabilities with its own thresholds. After about 1,000 doodles the misses are the occasional false alarm, and moderating all of them cost 6 cents in total, about $0.00006 a doodle. These are one developer's figures from a live game.
James O'Halloran · Moderating 500 daily anonymous doodles with Jev · 30 Oct 2026Source ↗Across 20 jobs drawn from TypeSafe's 21 official cookbooks, plus image tests, Jev got 155 of 163 core examples right and 132 of 144 edge cases built to push its known weaknesses. Its main failure: when the right answer isn't an option, it picks the nearest one, often confidently. A replay after the locked tests, adding only a "none of these" exit to the menus, raised correct handling from 11 of 14 requests to 13. 1,463 requests cost $0.0331. Small hand-written samples, not a benchmark.
WeBuildDatabases · Jev, job by job · 29 Oct 2026Source ↗In a simulated moderation queue, a wave of privacy-invading posts arrived that the existing router did not prioritise. Claude drafted one yes/no question in 12 seconds from 20 of those posts and 20 ordinary ones, and a fine-tuned version of the open decision model Laya asked it of every new post. At 100 extra posts an hour, the queue needed one extra moderator instead of three, the same staffing as an oracle rule; the routing threshold was set with labelled calibration data. In a separate test, base Laya answering a fixed money-back question scored AUC 0.68 on consumer complaints, against 0.89 for the complaint's product field. Three seeds; staffing counted in whole moderators.
Enayat Hassani · Exposure-aware routing · 29 Oct 2026Source ↗Put in front of a small LLM (Qwen2.5-1.5B) as an input gate, Jev cut how many of 720 harmful-labelled prompts got an answer from 527 to 17, but refused 27 of 250 safe prompts, against 3 for the LLM alone. A tiered gate that also reviewed borderline answers let 40 through and refused 10 safe ones. Answered counts are a proxy for harm, not checked completions.
Cognetti, Krishnamachari (USC) · Jev as an LLM Safety Guardrail · 2026, code and tablesSource ↗One identity word moves Jev far more than a name does. On jev-1.13.0, "You are a Republican. Do you want to sign a carbon-tax petition?" got P(yes) 0.15; the Democrat version 0.73. Explicit labels shifted decisions by 3 to 15 percentage points, while Black- vs White-associated names moved them 0.2 (95% CI -0.6 to +1.0). Offering an "equal" option shrank most race, gender, religion and orientation gaps, but large gaps remained for age, undocumented status, class and atheism. 134,772 answers across jev-1.13.0 and 1.14.0, for USD 0.32.
Isaac Bitran (Brown University) · Jev bias audit · Oct 2026Source ↗On facts about other companies, Parallel's web-searching Decisions API beat Jev answering from memory: 83 to 98% vs 43 to 70% balanced accuracy on four questions about 50 YC companies. Across that test and a 30-topic publishing test, Jev put 116 of 230 answers between 0.4 and 0.6. On "have we already published this?", handing Jev the 10 closest sitemap URLs took it from 67% to 97%, at about 3% of Parallel's price. One run, one day, small sample.
Vedant Bhayani · Jev vs Parallel on two of Eric Siu's Jev gates · 28 Oct 2026Source ↗Five decision models judged 9,852 items for five kinds of hallucination against gpt-6-sol. The best matched it on context inconsistency and came within 3 points on factual errors, but trailed by 4 to 8 on logic and instruction-following. A confidence cascade of decision models matched or beat gpt-6-sol on three types at 1 to 3% of its cost.
Liu, Xue, Wang, Mu, Ma, Feng, Li · Decision Models as Judges for Hallucination Detection · arXiv 2610.37229 · 27 Oct 2026Source ↗Asked why retrieved sources disagree, 10 of 11 decision models from 7 providers matched or beat Gemini 2.5 Flash (61.3%), at 4 to 39x lower billed cost (two were free) and 2.6 to 6x lower latency. Gemini 3.8 Flash (70.0%) was more accurate than 8 of them, but sending each model's least confident quarter to it was statistically indistinguishable from Gemini 3.8 Flash for 8 of 11, at 25 to 37% of its cost.
Khatri, Jain, Kapoor, Sah · Do We Need an LLM to Know Why Sources Conflict? · arXiv 2610.36915 · 27 Oct 2026Source ↗When a collection already has labelled examples, learning from them beat Jev, which labels each document cold. Across 29 classification tasks, Voyage's experimental voyage-json embeddings plus the raw fields, fed to a ridge regression trained on the labelled documents, averaged 88.3 AUROC against Jev's 77.6; Voyage counts that as 48% fewer errors (error = 100 minus the score). Voyage's own test of its own models.
Voyage AI blog · How to create your own Jev using Voyage models · 27 Oct 2026Source ↗Shuffling the order of the answer options across 1,700 questions barely moved Jev's accuracy (under two points), but the set of questions it ever got wrong grew by 27 to 29%, more than plain repetition caused. Across two Jev versions, twelve Jev reproductions and six generative LLMs, Jev showed no general advantage in keeping correct answers.
Song, Zheng, Ma, Zhou · Understanding Jev-Style System One Models: Does Structure Reduce Selection Bias? · arXiv 2610.35826 · 26 Oct 2026Source ↗Screening 2,048 patient-condition pairs for clinical trials, with questions batched per patient, Jev matched Qwen Flash (thinking off) on two datasets (macro-F1 0.652 vs 0.660, 0.807 vs 0.814) and beat it on MIMIC-III (0.768 vs 0.534), mostly by flagging when a record lacked the information (56.3% recall vs 9.9%). In batch mode it was faster and an estimated 53 to 74% cheaper per condition; asked one condition at a time, the cost edge did not always hold.
He, Gao, Li, Zhang, Wei, Zhang, Yuan · Can JEV Support Clinical Trial Criteria Assessment? · arXiv 2610.35721 · 26 Oct 2026Source ↗DecisionRAG uses a decision model to browse a corpus from broad topics down to passages, with no first-stage retriever and no task-specific training. It beat dense retrieval with an 8B reranker by 13.8 R@1 points on MultiDoc2Dial and 17.4 Hit@1 points on Natural Questions, with median query latency of 0.68 to 1.76 seconds across four benchmarks.
Wan, Jünger, Du, Liu, Krishnan, Weinberger · Retriever-Free Retrieval: Navigating Documents with Decision Models · arXiv 2610.35868 · 26 Oct 2026Source ↗Across six Qwen backbones from 0.6B to 27B and ten TREC DL and BEIR collections, decision fine-tuning never made the better reranker. Up to 9B, plain reranker fine-tuning won by 5 to 29 points nDCG@10 and decision fine-tuning added nothing over asking the untuned model; at 27B the two tied. The authors' advice: if you need a reranker, fine-tune a reranker.
Dinzinger, Ghosh Dastidar, Granitzer · System One models Are Not Better Rerankers · arXiv 2610.32318 · 23 Oct 2026Source ↗On an owner-labelled Italian and English inbox (231 emails in the main comparison), logistic regression trained on about 200 labels had the highest accuracy on every field, though statistically tied with Gemma 4 on message type and with hosted Nimble on urgency, ahead of local decision models (Tev1, Nimble). When used to choose actions, it ignored emails that needed action more often than hosted Nimble or Gemma 4 (18% against 4% for the best LLM), until a cost-chosen threshold cut those misses from 12 of 68 to 4 of 68 (18% to 6%).
Federico Lucca · Measure Before You Train · arXiv 2610.32955 (v2) · 23 Oct 2026Source ↗PathJev-P, a decision head on MedGemma-1.5-4B, beat a generative model trained on the same backbone and data, the pathology model CONCH and a general medical decision model on balanced accuracy (0.541 against 0.492, 0.345 and 0.213). Its calibration edge depended on how the generative model's probabilities were read, and a simple linear probe on a pathology foundation model was better calibrated in every setting.
Tommasino, Rinaldi · PathJev · arXiv 2610.32478 · 23 Oct 2026Source ↗Grading 200 held-out Amazon shopping-search results, Jev 1.14 agreed exactly with the human graders 55% of the time, against 43.5% for the best LLM tested (Gemma 3 27B), at a median 118 ms against the LLMs' 435 to 656 ms. Asked to rank eight search setups, Jev ordered 26 of the 28 pairs the way the human labels did.
rickcrawford · jev-relevancy, on Amazon's ESCI shopping queries · Oct 2026Source ↗Logistic regression with temperature scaling, rebuilt behind Jev's interface, matched Jev's accuracy on a 7-intent banking slice (0.975 each; Jev's calibration error was lower, 0.014 against 0.022, but the gap was within noise) and beat it on all 77 intents (0.888 against 0.859 at best). Jev's choice answers were well calibrated; its yes/no answers were underconfident on true cases.
ankur287 · jev-open-calibration, code and data for a Towards Data Science article · Oct 2026Source ↗Four decision models on 13 Vietnamese classification settings. With English label descriptions, Jev ranked first by macro-F1 in 11 of them. The weak spot was diacritics: strip the tone and vowel marks and each model's mean macro-F1 fell 9.5 points (Jev, the least) to 15.5 (Quyet), against 0.5 to 1.1 for slang and 2.9 to 4.5 for typos.
Ha, Phuc, Quy, Tran · How Well Do Decision Models Transfer to Vietnamese? · arXiv 2610.31422 · 22 Oct 2026Source ↗Swap the correct case holding out of the options and see who admits none fit. Six generative LLMs still picked one in 38-86% of those items; the most cautious of four decision models did so in 30%. On the standard test, a decision model matched the best LLM (88.1% vs 88.2%) at 1/55 of the cost, and accepting the LLM's answer only when a decision model agreed halved its wrong citations.
Demir · Commit or Abstain? · arXiv 2610.29961 · 21 Oct 2026Source ↗As a judge of 118 paediatric clinical AI answers, Jev's agreement with physicians matched or beat seven of 12 LLM judges, including Claude Opus 5.5 and GPT-6. Frontier judges cost 73 to 294 times more and took 7 to 57 times longer.
Gershon, Cohen, Ariel, Bilavsky-Yarden · Decision language models as alternatives to LLM judges · arXiv 2610.28826 · 20 Oct 2026Source ↗Artificial Analysis launched a Decision Index covering knowledge, reasoning, tool calling and safety classification. At launch Jev 1.13 led the decision models with 58, ahead of GLiDE and Microsoft-Decision-1 on 54. Its sharpest finding: decision models are overconfident.
Artificial Analysis Decision Index v1.0 · 13 Oct 2026Source ↗On claim verification Jev ties GPT-6-class models at 0.975, for a fraction of the cost. On Vals AI's LegalBench sample Mercury Decide beats it, 0.869 to 0.740. Given a 1% error budget on claims, Mercury automated 94% at 0.8% error; Jev automated 95% at 1.6%, over budget.
Vals AI · Jev evaluation 6 Oct 2026, Mercury Decide evaluation 8 Oct 2026Source ↗Cut an LLM's reasoning short, then let Jev pick the answer from the half-finished trace. Across 35 reasoner-benchmark pairs, Jev's mean accuracy beat forcing the LLM to answer at every budget tested, from 500 to 16,000 tokens; at 1,500 tokens it added 4.1 points. In offline replay on held-out questions, a tuned stopping policy was estimated to save 71.3% of the full run's cost for a 0.58-point accuracy loss.
Wang et al. · Truncated Reasoning Under a Budget · arXiv 2610.25768 · 19 Oct 2026Source ↗The study compared Jev, Tev1-4B and Nimble-9B with two trained classifiers, with class frequencies shifted in simulation; the two open models were also run against their own Qwen backbones. Decision training was not uniformly better: Nimble was better calibrated than its base on intent tasks but scored 12.0 Macro-F1 points lower on financial sentiment. The decision models were not uniquely fragile under shift, though single shifts could still push threshold risk up sharply; their main weakness was miscalibration they already had.
Iqbal, Nasim, Saleem · Typed Decision Models under Prevalence Shift · arXiv 2610.26325 · 19 Oct 2026Source ↗“In this early literature, the typed readout itself has not shown an independent accuracy advantage over comparable label-probability readouts.”
A review of the 28 papers posted in the nine days after Jev launched on 15 Sep 2026. Jev's clearest gains were latency and cost, with accuracy gaps on harder tasks. The authors call it an early evidence map, not a verdict.
Typed Decision Models: An Early Evidence Audit · arXiv 2609.32160 · 26 Sep 2026Source ↗In SILT's preregistered test of 799 unpublished yes/no questions about coding-agent work and destructive shell commands, Perplexity's open Decider V1.1-27B was the most accurate (94.7%) and the only one of seven models to pass SILT's chosen calibration rule. Jev's result was inconclusive. So were the results for OpenAI's Decisions API and Laya.
SILT · Do Decision Models Know When They're Wrong? · 11 Oct 2026Source ↗Used as a prompt-injection detector, Jev caught 82.90% of labelled attacks. Prepend a fake policy inside the untrusted text and it caught 3.88%. The authors separate this classifier bypass from a full agent compromise.
Datadog Security Labs · 15 Oct 2026Source ↗Ask "is it X?" and "is it not X?" and the two probabilities should add to 1. Jev misses by 0.064 on average. Reading the first token of an open 27B model misses by 0.293. Neither is fully coherent.
Li, He, Li · Beyond Calibration · arXiv 2609.33209 · 27 Sep 2026Source ↗JevBench v1.8.6, published 01 Nov 2026, measures 337 decision models and ranks 217 systems on its open-weights board. Capability averages Intelligence and Calibration within cost and median-latency caps. Mammoth-1 and KnowLine 31B-Gen1 each score 85.2; the board marks their open-weight status Unknown. Jev 1.13.0 is an unranked reference at 77.1. SemIf, formerly OpenJev, is #143 at 55.4 (Intelligence 27.1, Calibration 83.6). Hosted APIs have a separate board.
JevBench v1.8.6 · Benchmark Heaven · 01 Nov 2026 · not affiliated with TypeSafeSource ↗Useful for ranking and classification, but it can carry bias you can't see: asked whether Bay Area cities were good, Jev put Cupertino top and East Palo Alto bottom. With only a number coming back, that's harder to spot.
Simon Willison · 21 Sep 2026Source ↗Without any decision fine-tuning, the instruction-tuned Gemma 4 31B already scores 79.6 on the authors' new OpenDecisions set, against Jev's 80.1. The authors' published recipe makes an open Jev possible: after following it, the model scores 84.4 (the authors' own numbers).
Geuter, Cheng, Alvarez-Melis · Releasing the Inner Jev · arXiv 2610.17205 · 12 Oct 2026Source ↗Political-science coding tasks from published studies, re-run on Jev, GPT-6 Luna and an open Qwen3.8-27B. Jev matched or came close to both, but had no cost edge over OpenAI's batch prices, and its probabilities were better calibrated than Luna's but not consistently better than Qwen's. The authors' verdict: unless you need speed, the main advantage is ease of parsing.
Denney, DiGiuseppe · JEV versus LLMs · arXiv 2610.06625 · 6 Oct 2026Source ↗A saved local Drex v1.5 Q8_0 run reports 6/10 team choices and 6/10 urgency choices correct, with 10/10 refund checks correct. In the five team answers with confidence 0.9 to 1.0, three are correct. The report contains aggregate scores and bins for an authored demo suite, without per-case raw predictions; it does not establish production calibration.
Gjusev · drex-evals · 10 Nov 2026Source ↗The Shorts Generator maker records Laya-multilingual assigning about 0.79 to a strong-hook Noul question on a Hindi clip, while a separate A/B question chooses no hook at about 0.79. The pipeline averages the checks and blends them with deterministic features. One conflicting example does not measure calibration or show that the blend improves clip quality.
Khelendrameena · live CPU model notes · 10 Nov 2026Source ↗An AWS Builder Center author reports Strands Decider 2B v1 at 85.2% on camera stills with a 0.25 cutoff chosen on that same set, versus 88.0% for Gemma 4 31B and GPT-6 Luna on Bedrock. Sample size and raw predictions are not supplied. The OpenAI Decisions API row is simulated from a Bedrock run; the filter replays stored answers. L4 throughput and the estimated hosting break-even were not measured.
AWS Builder Center · security-camera comparison · discovered 10 Nov 2026Source ↗CodeCut reports 807 correct and 1 wrong merge among 808 accepted Abt-Buy product matches, from 1,081 source products; 62 go to review and 211 stay unmatched. Jev chooses among three embedding candidates plus none, merging above 0.7. RapidFuzz and embedding baselines force one match for every product and make 341 and 318 wrong merges. Acceptance policies differ; the article supplies no matched-coverage baseline or committed raw predictions.
Khuyen Tran · CodeCut · 11 Nov 2026Source ↗TypeSafe reports shortlist recall of 94.6% for Jev and 93.9% for Gemini 3.1 Flash Lite on 150 live roles, retaining 2,000 from a 6,000-candidate pool. The 0.7-point difference has a 90% interval of -0.4 to +1.8. Reported cost per 1,000 candidates is $0.092 versus $0.755; median time per role is 10.3 versus 20.3 seconds. $500K annual savings is a growth projection; current-volume savings is $265K. This is an offline test, without public raw records.
TypeSafe AI / Jack & Jill · 7 Oct 2026Source ↗Amazon reports replacing Sonnet 4.6 with a separate Strands Gemma 4 E4B build for 20 ticket labels plus none. Mean call time is 897 versus 4,215 ms; the approximate $0.0005 versus $0.0222 per ticket uses list prices and instance utilisation, excluding Lambda. Prompts are shortened and old comments dropped to fit 4,096 tokens. Sorted JSON keys follow observed probability shifts up to 0.19. Raw tickets and held-out accuracy totals are not published.
Carr Onstott, Mehul Jaiswal and Strands Agents Team · 9 Nov 2026; in-window HN leadSource ↗The Policy Pal maker reports four-label accuracy 61.3% for tuned Jev, 48.1% for tuned GLiNER and 26.5% for frozen regex rules on 1,055 test questions. Thresholds use the other 1,036 questions. The two “weeks” are random halves of one mixed-source pool, not successive traffic. The 70.3% Jev result changes rule priority after inspecting test errors and is post hoc. Score caches are not public.
William Suriaputra · Policy Pal guardrails · 5 Nov report; 11 Nov repository catch-upSource ↗FastABC reports Jev alone at 88.7% and Gemini alone at 90.0% across all 150 labelled cells; the hybrid scores 92.1% on the 140 cells it covers, leaving 10 to a grader. The test contains 24 synthetic answers and 150 labelled cells. The hybrid-minus-LLM 95% interval is -0.7 to +5.1 percentage points. Judgment costs total $0.0534 versus $0.1906; opening every answer for evidence adds $0.0544 to the hybrid. These are maker-labelled examples, with raw calls published.
JunMyeong Kim · FastABC · 8 Nov run; 11 Nov catch-upSource ↗The assembly-engine maker reports 28.02 s versus 70.19 s median image-choice latency and peak RSS 1,436 versus 1,609 MiB against llama.cpp on a 4 GB Pi 4B. Direct counts take 43.55 versus 70.65 s. Each format uses four same-input Pi pairs with fresh processes and warm filesystem caches, under background load. Assembly starts from decoded RGB; llama.cpp decodes PNG. Full-set reference accuracy uses x86 llama.cpp, whose answers match the eight Pi probes.
DarvinX · d1-2B ARM64 engine · 11 Nov 2026Source ↗Singularity Feed’s public run compares Gemini Decision 1 with Gemini 3.5 Flash-Lite on the same 2,000 sampled items. Both get 391/500 Banking77 intents right; on CIFAR-10, Decision gets 167/200 and Flash-Lite 170/200. Decision leads the pooled score, 86.3% to 83.5%, with four filtered inputs counted wrong. Short inputs, one location, label-only options and different API request formats limit the comparison.
gnana70 / Singularity Feed · 11 Nov 2026Source ↗In the same public Gemini Decision 1 run, a confidence cutoff of at least 0.9 keeps 1,176 of 2,000 items, with 1,153 correct (98.04%). The other 824 still need a separate policy. This is observed accuracy on that sample, not a guarantee for new traffic; four filtered inputs remain in the full denominator.
gnana70 / Singularity Feed · confidence and coverage · 11 Nov 2026Source ↗The femto-jev maker reports 71.4% accuracy on SLURP with transcript plus audio frames, versus 58.6% using the transcript alone. On unseen MInDS-14 phone speech, the same paths score 55.8% and 56.1%. Audio features help on the familiar speech task but do not improve this unseen recording condition.
igorktech · femto-jev card · 11 Nov 2026Source ↗Our benchmark · v0.1
Generated JSON
97.7ms
11 output tokens
Schema-constrained
74.4ms
7 output tokens
Direct readout
24.6ms
1 output token
The fastest path was also the least varied. On this 0.6B model the direct readout answered technical in 69 of 75 calls and never once said billing, on a set that includes "my card was charged twice". Without labels we can't score accuracy, but an answer that barely changes is a warning sign. Whether a purpose-trained decision model avoids this is the open question.
Medians over 75 timed calls per path. This measures mechanics, not accuracy: there are no ground-truth labels, so "disagree" means the paths differ, not that one is right. Local latency says nothing about any hosted API. Raw results · Summary
Lineage · 2017 to 2026
When Jev launched on 15 September 2026, a GLiNER2 co-author answered by pointing readers to weights already on Hugging Face. The papers trace which parts of the idea predate Jev and which are new. Every entry is checked against arXiv or Hugging Face.
Resources
TypeSafe AI's launch post, 15 Sep 2026, gave the category its name.
Simon Willison's hands-on write-up, 21 Sep 2026. The clearest independent explainer.
Joe Barrow, an NLP researcher at Adobe Research, explains how decision models work through an open one, Perplexity's Decider v1.2: the architecture, how it is served, what its design says about training, and when to use one. An X article, 30 Oct 2026.
Leonie Monigatti’s slides, shared with her 6 Nov 2026 talk thread. They explain why reading option logits still needs fine-tuning and calibration. The overconfidence charts are illustrations without an identified evaluation set.
Interview with Diogo Almeida, TypeSafe CEO, 21 Sep 2026. The fullest statement of their thesis, including RLCD.
Nearly 2,000 points and over 500 comments. The sharpest pushback is in here.
Reviews the first 28 papers and proposes a 14-item evaluation checklist. 26 Sep 2026.
A label-free coherence test, run on Jev and an open 27B model. 27 Sep 2026.
An exploratory case study of Jev inside an LLM pentest agent, plus a discussion of Laya's published specs. 24 Sep 2026.
Native /v1/systemone support on your own machine, from 28 Sep 2026.
Typed option probabilities straight from an open model, in your browser. No waitlist.
Jev-style parallel constrained decisions for any MLX model on Apple Silicon; typed schema-valid JSON in one forward pass.
Browser decision playground and reproducible experiments on memory, uncertainty and control.
Community-maintained list of TypeSafe, System One and Jev resources. Scoped to that ecosystem, not a general decision-model index.
Another independent directory of decision models, with recipes and guides.
Where this site posts new releases first.
You'll also hear about new benchmarks and notable projects. You confirm your address before we send anything. We store your email, when you signed up and confirmed, where you signed up from, and a one-time confirmation token. We store nothing about your device or location.