LATESTLaya medical specialty · open weights →

AI for decisions.

Decision models return structured answers, such as categories, scores or yes/no probabilities, for games, websites and AI agents. Jev returns these without generating text; some alternatives generate an option letter.

Releases

Releases since Jev launched on 15 September

TypeSafe AI released Jev and named the category. Every model below links to its model page.

  1. Jev · TypeSafe AI ·
  2. Laya · Convai Innovations ·
  3. Nimble · Bespoke Labs ·
  4. Decision 1.0 · vLLM Semantic Router ·
  5. Tev1-4B · Together AI ·
  6. Span-01 · Respan ·
  7. GLiNER2.5-Decide · Fastino ·
  8. Julia 1 · Supersonic Labs · Published weights and Python runtime; September catch-up:
  9. Intern-Decision · InternLM · First Hugging Face upload:
  10. Solar Decide · Upstage · OpenRouter announcement:
  11. Ollama v0.35 · Ollama ·
  12. d1 · Liquid AI ·
  13. Mercury Decide · Inception ·
  14. Kev · Jared Palmer ·
  15. JevAlt · Mert Kaya (Eschatia Labs) · October weights; catch-up discovery:
  16. DecisionTune 1.0 · DecisionTune · Hugging Face repository upload:
  17. Valen · Valen Team · First Hugging Face weights upload:
  18. Decisions API · OpenAI · Public beta launch:
  19. Decider · Perplexity ·
  20. H2O-Lightning-4B · H2O.ai ·
  21. KnowLine · PelaAI · First Hugging Face family release:
  22. Snowflake Decision · Snowflake ·
  23. Microsoft-Decision-1 · Microsoft ·
  24. Clef-omni · Cloudflare ·
  25. Jeva 4B · Qi Li and Xinchao Wang (NUS) · Weights upload:
  26. Strands Decider 2B v1 · Strands Labs · Hugging Face weight release:
  27. Arc-decide · Arc53 (DocsGPT) · Hugging Face v0.2 upload:
  28. Granite Switch 4.1 · IBM ·
  29. MNN-Pocket-0.3B-Dec · Taobao MNN · First published Hugging Face package; October catch-up:
  30. TYGER · NineNineSix ·
  31. Clairic · Cloudflare ·
  32. GLiDE · Fastino · Weights repository upload:
  33. Zoom Decisions API · Zoom ·
  34. Qev 0.8B · labqoat · Hugging Face weights upload:
  35. Mammoth 1 · Baseten (Base Labs) ·
  36. Talos · Tractian · Repository and weights upload:
  37. LingDT-Decision-1.0 · Ant Digital Technologies (蚂蚁数科) ·
  38. MiniCPM-OCR Jev · OpenBMB · First Hugging Face upload:
  39. Fovea-4B · Sivasuthan · Weights upload:
  40. Parallel Decisions API · Parallel ·
  41. homi · egma-ai · Hugging Face weights upload:
  42. UltraBERT Curation · Daniel van Strien ·
  43. Nimbus · Crele · Hugging Face weights upload:
  44. ZeroPoint · Javier Marín · First published package release; October catch-up:
  45. Ru-Jev · besktech (beskvladimir-create) · First Hugging Face repository creation:
  46. JDI-Decision-V1 · JD Industrials · Weights upload:
  47. Hume Audio Decisions API · Hume AI ·
  48. Smaug-Decisions · Abacus.AI · Maker blog announcement:
  49. medical-jev-4b · JuneYao · Weights upload:
  50. hs-decide-1-flash · Vectorize (Hindsight) ·
  51. REAX 1.3 · REAX ·
  52. K-Decision-9B · ONYULTEA · First Hugging Face upload:
  53. Reflex · Morph · OpenRouter listing date:
  54. Sarvam Prism · Sarvam AI · Hugging Face package release:
  55. Horopter beta-3 · Fight Fire with Fire Robotics · Beta-3 release; first release 20 Oct 2026:
  56. TS-PRGuard · typestrict (Lucas Duarte) · Public release:
  57. wps-decision-1 · Kingsoft Office · Public release:
  58. d3-mini-agentcode · stonefish-labs · Public release:
  59. Lory · eltokh7 · Public release:
  60. Glimmer System One · Aryan Srivastava · Public release:
  61. laya-slotjudge-m46 · Christophe Cruz, Hussam Ghanem and Hocine Cherifi · Model-card release:
  62. Kev LUX Places · Yale Cultural Heritage AI · Hugging Face package release:
  63. d1-qwen-0.6b · Grizzlykw · Hugging Face package release:
  64. SecJev-4B Spot2 V3 · macmacmacmac · Hugging Face package release:
  65. CodeSync Knack · DevsHub · Hugging Face package release:
  66. Heimdall D1 V6 · Toby-NoSkillSon · Hugging Face package release:
  67. Copernicus 31B / 57B · Poindexter Labs · First Hugging Face package release:
  68. Scantron Preview · aidendle94 · Hugging Face package release:
  69. Cicero · Butler Compute · Hugging Face package release:
  70. kai-decision / K-IM-Deiction · Songkai · First Hugging Face package release:
  71. Jev-style spam LoRA · Abubakar Abid · Hugging Face package release:
  72. RSI-Jev v7.0-VL family · Shanghua Gao · First Hugging Face package release:
  73. Spot Snake decision fine-tunes · Lucasgitguy-co · d1/MiniMind-JEV licence clarification; Laya weights uploaded 6 Nov:
  74. JAD-S1-7B-A1B v0.3 · DreamBlooms · Hugging Face package release:
  75. swiftpick-30B-A3B · harishvs · Hugging Face package release:
  76. Saif 4B v2 · GyrTechnology · v2 decision-only package release:
  77. karpo-decision-31B · MachinePulseAI · Hugging Face package release:
  78. JevStyle 2B · Chaoliang Yan · Hugging Face package release:
  79. Laya spam classifiers · Nikita Kolmogorov · Hugging Face package release:
  80. Kanana-2-v-decide · Kakao · Weights upload:
  81. Agastya Decision RAG 2B · Andra Labs (Amartya Sai Andra) · Weights upload:
  82. Qwen3.5-4B-Router-1M · Maziyar Panahi · Weights upload:
  83. Decisio 12B tuned v2 commit · tachara-ai · Weights upload:
  84. Rein r1 family · jmc0 · Weights upload:
  85. Vev 4B v2 · Wang Xiaolong · Weights upload:
  86. Compliance Decisions 0.8B · souvickdascmsa019 · Weights upload:
  87. Decido 1 family · decido-ai · Weights upload:
  88. Saif 0.8B Lightning · GyrTechnology · v0.3 weight update:
  89. termite-decide 0.8B · Tane Piper · Weights upload:
  90. RASD Laya track classifier · Galal Ban Amr · Selected weights upload:
  91. MoDe S / M / L · newrexlabs · Weights upload:
  92. Laya Minecraft · Thomas Tesche · Weights upload:
  93. medgemma-decide-4b-v2 · Amaljith · Weights upload:
  94. Logits Sigma-1 / Duo · Logits · Weights upload:
  95. LocHeal Verdict 2B · kinasr · Weights upload:
  96. Adjudex · NewsBang · 9B v5 and 0.8B v5 weight releases:
  97. Vica Laya · tory-labs · 2026.11.08.1 trained release:
  98. OneJev 31B · OmniJev · OneJev1.6g weight release:
  99. LingeeJevMulti-4B-v1 · Ashan0525 · Weights upload:
  100. d1-2B RAG Verifier · landtml · Weights upload:
  101. Amada · LiamDB · GitHub weight release:
  102. Rein-NPC-4B · jmc0 · Hugging Face weight release:
  103. Laya Descent v4 · Eren Terakye · Hugging Face weight release:
  104. Chinese Decision Pointer 4B · quincyqiang / yanqiangmiffy · Hugging Face weight release:
  105. Aster-JEV-27B · k2021211255 · Hugging Face weight release:
  106. Jevora 9B · kadirbekovvv / doxanocap · Pinned V1.6 package at 06:55 UTC; catch-up verification:
  107. Domyn-Edge-Jev-Decision · Mahesh Deshwal · Hugging Face weight package release:
  108. Clashbot d1-ft-joint-tac · Jyler · Hugging Face weight package release:
  109. QEV Compact · Ken Jo · Hugging Face weight release:
  110. GameDecider · Holdout Labs · Hugging Face weight release:
  111. MANTA · Gevaert Lab · Hugging Face weight release:
  112. N-Q-26M-JEV · Q Project · Hugging Face weight release:
  113. ARC 1.0 · Rayline · Hugging Face weight release:
  114. GS1 · BIGAI · Hugging Face weight release:
  115. ANT · Semantique Team · Hugging Face weight release:
  116. decider-ja 0.5B · ken11 · Hugging Face weight release:
  117. ProbeLoop Laya stated limits · submsk · Hugging Face weight release:
  118. SubQ Snap · Subquadratic · Snap 1.2 release:
  119. Ainvest Decision 31B v2.0 · Ainvest-World · Hugging Face weight release:
  120. newTokenEra decision 27B · NewTokenEra · Hugging Face weight release:
  121. Gemini Decision 1 · Google DeepMind · Google announcement:
  122. femto-jev · igorktech · Hugging Face weights, 15:42:55 UTC:
  123. Laya medical specialty · AI Anytime · Hugging Face weight upload, 19:54:59 UTC:

How it works

What happens in one call

1

You send what your app knows

A message or an agent's history can be input. You can also send a game state or a web page.

state "My card was charged twice."
2

For Choice, you list the possible answers

For a Choice question, you supply the allowed options and receive probabilities for them.

which team?
billingtechnicalsales
3

It returns a probability for each

Use the probabilities to decide which answers to act on and which to send to a person or a bigger model.

billing.94
technical.04
sales.02
→ route("billing")

The odds above illustrate a Choice question. Jev, and the models built to its API, also take Noul questions, which return a yes/no probability; the name comes from the Bernoulli distribution. A Score question returns a value along your defined scale, which can fall between the numeric levels you supply. source.

How generative LLMs compare

A generative LLM can return structured output that your code reads. It generates its answer one token at a time. Jev returns structured answers without generating text. Together reports that Tev1 keeps a text-generation head and is trained to return one option letter. Simon Willison Together

Compare decision models with classifiers, embeddings and rules. See the task results and what each comparison leaves untested.

Where the name comes from

TypeSafe calls Jev a System One model, after Daniel Kahneman's split between fast, intuitive thinking and slow, deliberate reasoning. Liquid AI uses "decision models" for d1. TypeSafe Liquid

Is it new?

The interface isn't. Scoring declared labels in one pass goes back years, from zero-shot classifiers to GLiNER. What is new is a hosted model sold for it, with calibrated probabilities as its stated training goal, at this price and speed. The lineage

Use cases

What people are using decision models for

The newest builds we've found. Each card links to its use case, with a source for the example.

Alert paging

Should the on-call engineer be paged now?

page · do not page

Example: Coroot paging benchmark · Source ↗

Mobile apps

Could executing this action cause data loss, a charge, a logout, an account or permission change, a message sent to another person, or another irreversible side effect?

yes · no

Example: jev-droid · Source ↗

Search ranking

How relevant is this result to the query?

a score on a scale

Example: Simon Willison on reranking with Jev · Source ↗

Models

Every model we know of, with sources

Hosted models, open weights you can run yourself, and the community projects around them. Tap any entry for what it is, what its maker claims, and where that claim comes from.

Jev

TypeSafe AI · 15 Sep 2026 · HOSTED

The model that named the category. A hosted API: send your app's state plus typed questions (Choice, Score or Noul) and get a probability back for each answer. It generates no text, and its weights are not public.

Price
$0.042 per million input tokens; output free · Compare prices
Latency
70–500 ms end to end (TypeSafe-reported)
Version
jev-1.13 is the stable release; jev-1.14 has been the preview build since 14 Oct 2026
Context
262,144 tokens on OpenRouter (listing and guide checked 8 Nov 2026); direct-provider limits may differ
Access
Launched in early access; also via OpenRouter
Question types
Choice, Noul and Score; experimental Box questions require Jev 1.14
  • 40x–200x faster than frontier LLMs on comparable tasks vendor reportedsource
  • Trained with Reinforcement Learning for Calibrated Decisions (RLCD); no technical paper published as of 2 Oct 2026 vendor reportedsource
  • Leads JevBench's capability ranking of Jev-class systems (80.0) on 1 Oct 2026 independentsource
  • No public weights: TypeSafe's own Hugging Face account listed zero public models when checked on 20 Oct 2026 vendor reportedsource
  • The 14 Oct 2026 update switched on experimental image input and opt-in long context for Jev 1.13 and 1.14 (1.13 was "multimodal all along"); bounding-box answers need 1.14 vendor reportedsource
  • Tops Artificial Analysis's Decision Index at launch with 58, ahead of GLiDE and Microsoft-Decision-1 on 54 (13 Oct 2026) independentsource

Decisions API

OpenAI · Public beta launch: 6 Oct 2026 · HOSTED

OpenAI's Decisions API uses GPT-6 Luna to return typed answers for classification, routing and agent actions. It launched in public beta on 6 Oct 2026 and became generally available on 22 Oct. Developers supply the questions and allowed answers; the endpoint returns probabilities, choices or rubric scores.

Model
gpt-6-luna only
Access
Generally available since 22 Oct 2026; public beta launched 6 Oct; native GPT-Live integration since 15 Oct
Price
$0.10 per million uncached input tokens; output free · Compare prices
Inputs
Text, images, JSON and conversation history with tool calls and outputs
Questions
Up to 400 per request, increased from 200 in public beta
Endpoint
POST /v1/decisions

    d1

    Liquid AI · 29 Sep 2026 · HOSTED

    Liquid AI's decision model family. The hosted d1 takes the same three question types as Jev (Noul, Choice and Score). On 7 Oct Liquid released two small open siblings you can run on a device, and on 15 Oct a bigger hosted one, d1-ultra, joined OpenRouter. On 27 Oct d1.1, the successor to d1, joined OpenRouter at the same price, with -latest aliases that follow each family's newest version. On 27 Oct Liquid announced two more open models, d1-2B (text, pictures and video) and d1-Omni-2B (adds audio), built on LFM3; their Hugging Face repositories went up on 24 Oct.

    Hosted
    d1.1, d1 and d1-ultra, via Liquid's API and OpenRouter
    Open weights
    d1-3B and d1-omni-600M (7 Oct), then d1-2B and d1-Omni-2B (announced 27 Oct), under the LFM Open License v1.0
    Price
    OpenRouter lists d1 and d1.1 at $0.02 and d1-ultra at $0.042 per million input tokens, output free (as of 28 Oct 2026) · Compare prices
    • Liquid says d1 is the first model to beat Jev on the Jev Decision Index, a community index hosted on Hugging Face. We could not find a d1 result in the index's public data (release 0.2.1, generated 28 Sep) vendor reportedsource
    • d1-3B answers a question in 16 ms on an NVIDIA Jetson AGX Thor vendor reportedsource

    Mercury Decide

    Inception · 30 Sep 2026 · HOSTED

    Inception's decision model, served as a System One endpoint: send state and typed questions, get a choice, a score or a yes/no answer, each with a probability.

    Price
    $0.02 per million input tokens at a 50% discount, output free; a free tier remains (OpenRouter, as of 22 Oct 2026) · Compare prices
    Context
    66K tokens (OpenRouter)
    Access
    OpenRouter
    • Up to 14 decisions per second vendor reportedsource
    • The most intelligent decision model on OpenRouter, on JevBench v1.4 (the board was on v1.5.4 as of 2 Oct 2026) vendor reportedsource
    • On Vals AI's LegalBench sample, 0.869 to Jev's 0.740 accuracy; on claim verification its router stayed inside a 1% error budget where Jev's went over independentsource

    Solar Decide

    Upstage · OpenRouter announcement: 28 Sep 2026 · HOSTED

    Upstage's decision endpoint, available through OpenRouter. The date is when OpenRouter announced it; we have not found an announcement from Upstage itself. A faster sibling, Solar Decide Flash, joined on 8 Oct 2026 with a 524K context.

    Price
    OpenRouter lists $0.05 per million input tokens, output $0 (as of 2 Oct 2026); the launch post described a limited-time 50% discount · Compare prices
    Access
    OpenRouter

      Span-01

      Respan · 24 Sep 2026 · HOSTED

      A one-pass classifier for agent traces. For each behaviour you define, it returns the probability that it is present, absent or not observable, without generating text. Respan's later Span-02 (15 Oct 2026) reads images too, can return a number directly, and ships as Apache-2.0 open weights.

      Price
      $0.02 per million input tokens; output free · Compare prices
      Free tier
      Span-01 Lite
      Maker
      Respan, a Keywords AI product
      • Beats GPT-6 Luna and Jev 1.13 on Respan's own behaviour-detection benchmark vendor reportedsource

      Decider 1

      meraGPT · HOSTED

      A hosted decision model served only at /v1/systemone, the request format TypeSafe's SDK speaks. Its site doesn't say who runs it or when it launched.

      Price
      $0.03 per million input tokens; output $0 · Compare prices
      Endpoint
      /v1/systemone
      • 0.768 accuracy against Jev's 0.727 on typed-decision benchmarks vendor reportedsource

      Microsoft-Decision-1

      Microsoft · 9 Oct 2026 · HOSTED

      Microsoft's decision-scoring model for routing, classification, prioritisation, verification and workflow control. Post-trained from Qwen3.5-9B, available in Microsoft Foundry and on OpenRouter.

      Price
      $0.042 per million input tokens; output free · Compare prices
      Base
      Qwen3.5-9B
      Access
      Microsoft Foundry, OpenRouter
      • Ties GLiDE for second on Artificial Analysis's Decision Index at launch, on 54 (13 Oct 2026) independentsource

      Clef-omni

      Cloudflare · 9 Oct 2026 · HOSTED

      The Clef family on Workers AI answers typed questions in one pass. Clef-omni adds audio and video, so it can decide about what is seen and heard at the same time. The same update cut Clef-flash to $0.038 per million input tokens.

      Size
      30B mixture of experts, 3B active
      Price
      $0.150 per million input tokens · Compare prices
      Access
      Cloudflare Workers AI; Clef-flash weights are on Hugging Face

        Snowflake Decision

        Snowflake · 8 Oct 2026 · PREVIEW

        A decision model you call from SQL. It classifies, scores, filters and routes rows inside Snowflake through AI_COMPLETE. A lower-latency Decision Fast, with REST access, followed on 19 Oct.

        Access
        Private preview in Cortex AI Functions
        Limit
        Up to 32 options per question
        • Scored 57.63 on a subset of the Hugging Face decision benchmark (the 32-option limit rules out the full suite) vendor reportedsource

        SubQ Snap

        Subquadratic · Snap 1.2 release: 11 Nov 2026 · API

        Subquadratic reports a 384K-token context for text and images. Snap 1.2's reported price is $0.04 per million input tokens. Subquadratic's 11 Nov 2026 release note says requests using retired subq-snap-1.1 and subq-snap-preview IDs route to 1.2, and advises retesting thresholds because decisions and probabilities may change.

        Price
        $0.04 per million input tokens; output free · Compare prices
        Inputs
        Text and images; vendor-reported 384K-token context
        Access
        Subquadratic's API; the Snap 1.1 Baseten listing is a separate route
        API model
        subq-snap-1.2; subq-snap-latest alias. Retired subq-snap-1.1 and subq-snap-preview IDs route to 1.2
        • Subquadratic's 22 Oct 2026 release post quotes an Artificial Analysis Decision Index score of 65 for SubQ Snap 1.1, tied for #1. This figure is quoted by the vendor. vendor reportedsource
        • Subquadratic says Snap 1.2 choice results are identical across option orderings. The release note gives no numeric accuracy improvement. vendor reportedsource

        Classify-1

        ScaleDown · OpenRouter listing: 13 Oct 2026 · HOSTED

        Scores text or a whole document against your own choice, yes/no and ordered-scale questions. Request-compatible with Jev's Decisions API. The date is OpenRouter's listing.

        Context
        1M tokens (OpenRouter)
        Access
        OpenRouter, ScaleDown API

          Clairic

          Cloudflare · 19 Oct 2026 · PREVIEW

          A new branch of the family: a System One extraction model. Where a decision model picks from answers you list, Clairic extracts, computes, estimates or forecasts values from unstructured input and returns them as typed answers: an invoice total, a delivery date, a repair cost, a 24-hour traffic forecast. It does this quickly, without an LLM writing prose.

          Access
          Workers AI as @cf/cloudflare/clairic; back on OpenRouter as cloudflare/clairic when checked 4 Nov 2026
          Weights
          Cloudflare says open weights are coming soon (as of 19 Oct 2026)
          Price
          $0.10 per million input tokens on OpenRouter; output free · Compare prices
          Inputs
          Text and images
          Context
          65,536 tokens on OpenRouter
          • Higher accuracy, lower latency and lower cost than traditional LLMs at extraction vendor reportedsource

          Parallel Decisions API

          Parallel · 25 Oct 2026 · HOSTED

          A decision engine that searches the live web before it answers. You send typed questions about a company, product or policy, and one call returns typed answers with probabilities (or a refusal) plus a shared list of the web pages it used, so it can answer things a model only knows from training data cannot, such as whether a company has an open job right now.

          Access
          Hosted API, with a playground; 5,000 free requests to start; Decisions Fast also on OpenRouter from 6 Nov 2026, with a seven-day free promotion
          Price
          $1 per 1,000 calls (as of 25 Oct 2026) · Compare prices
          Grounding
          Searches the live web per request; citations cover the whole call, not each answer
          Latency
          VENDOR-REPORTED: 0.56 seconds median on PWS-Decisions, measured by Parallel on 29 Oct 2026 (Pacific).
          • Parallel says it costs 10x less than a standalone model vendor reportedsource
          • Parallel reports 76.22% on its own 300-question PWS-Decisions set with live web search, against Perplexity Decider v1.2 at 50.89%, OpenAI's Decisions API at 41.67% and Jev 1.14 at 33.44%, run without web access or supplied external context. Uniform random guessing is 42.42%. LLMs with native search scored 96.56% to 97.33% at about 16.5 to 28.8 times the cost. Parallel generated these questions from its own customer topics; dataset terms prohibit redistribution. vendor reportedsource
          • The benchmark blog chart labels Baseten Elephant at 32.4% overall and 32.3% public. The repository records Baseten Mammoth at 45.0% overall and 37.0% public. vendor reportedsource

          Kev

          Jared Palmer · 1 Oct 2026 · OPEN

          Kev is Jared Palmer's family of open, Jev-compatible decision models, from 0.8B to 27B parameters. A pointer head on a Qwen base scores each option, and the API matches TypeSafe's, so their SDK works against a local Kev server. Kev 1.0, released 1 Oct 2026, pins the family's checkpoints, model cards, evaluation suites and serving code; it introduces no newly trained weights.

          Sizes
          0.8B, 4B, 9B, 27B
          Licence
          Apache-2.0
          Base
          Qwen3.5 (27B: Qwen3.8)
          Release
          Kev 1.0, 1 Oct 2026
          Stars
          9,758 on GitHub (GitHub API, 2 Nov 2026)
          Price
          $0.042 per million input tokens and $0 per million output tokens for jaredpalmer/kev-4b on OpenRouter (VENDOR-REPORTED, 2 Nov 2026) · Compare prices
          Validated context
          VENDOR-REPORTED: 65,536 tokens for Kev-27B; 8,192 for 0.8B, 4B and 9B, measured on CUAD contracts
          • Kev 1.0's breadth-v1 held-out-dataset test scored a chance-corrected index of 23.3 for 0.8B, 38.0 for 4B, 41.0 for 9B and 52.3 for 27B, against Jev's 54.0, in the maker's fp32 evaluation at shipped temperatures. No Kev trained on these datasets. vendor reportedsource
          • Kev-27B's 65,536-token validated context is the longest tested state whose CUAD accuracy stays within three percentage points of its 8k-token accuracy at the 95% lower bound. The smaller models already miss that tolerance at 16k. vendor reportedsource

          DecisionTune 1.0

          DecisionTune · Hugging Face repository upload: 4 Oct 2026 · OPEN

          A local decision model built on ModernBERT-large: give it a state, a question and options, and it returns a probability for each option in one encoder pass. It handles choice and yes/no questions without generating text, through PyTorch, MLX or ONNX. The open weights are under Apache-2.0. The date is when the weights repository went up on Hugging Face.

          Size
          395M parameters, ModernBERT-large plus a 4 KB scoring head
          Licence
          Apache-2.0
          Context
          8,192 tokens; longer sequences are refused
          • The maker reports 29.57 on Decision Index 0.2.1 (raw 46.80) from one complete run, with a second seed scoring 29.13 (raw 45.96). These are the maker's runs, not an independent reproduction. vendor reportedsource

          Tev1-4B

          Together AI · 23 Sep 2026 · OPEN

          Together's Jev-inspired experiment: a Qwen3.5-4B fine-tune that reads a state, a question and 2 to 24 lettered options. Together says plainly it is not a non-autoregressive runtime like Jev: it keeps a standard next-token head and generates its answer as one letter.

          Base
          Qwen3.5-4B
          Licence
          Code MIT; weights licence being finalised as of 2 Oct 2026
          Run it
          Together serverless, or Ollama
          • Together reports 880/1,000 (88.0%) and 300/300 (100%) on evaluation sets used during development (VENDOR-REPORTED). vendor reportedsource
          • In jev-rsi's independent baseline test, the author measured untuned Qwen3.5-4B using Tev1's decision protocol through local Ollama at 673/1,000 (67.3%) on test and 130/300 (43.3%) on policy_transfer. independentsource

          GLiNER2.5-Decide

          Fastino · 24 Sep 2026 · OPEN

          A 340M-parameter encoder decision model from the team behind GLiNER, fine-tuned from GLiNER2. It scores the allowed answers to typed questions in one pass and is small enough to run on a CPU.

          Size
          340M parameters
          Licence
          Apache 2.0
          Latency
          167 ms p50 on a Xeon CPU, 38 ms on a V100 (Fastino-reported; batch 1, 64-token input)
          • Best average across 17 datasets on Fastino's own benchmark: 60.1% in the launch post, 60.2% on the model card as of 2 Oct 2026 vendor reportedsource

          Laya

          Convai Innovations · 18 Sep 2026 · OPEN

          A non-autoregressive decision engine on ModernBERT-large (421M), with a 322M multilingual sibling. Its author, Nandakishor Mukkunnoth, says he built the same approach a year before Jev launched.

          Size
          421M (English), 322M (multilingual)
          Licence
          Apache 2.0
          Latency
          32.8 ms on a single GPU (maker-reported)
          • 6 to 8 times faster than Jev vendor reportedsource
          • Built and open-sourced a non-autoregressive decision model a year before Jev vendor reportedsource

          Nimble

          Bespoke Labs · 18 Sep 2026 · OPEN

          A 9B decision model, LoRA-tuned from Qwen3.5-9B, with its 2,676 training examples published. One of the first two models in Ollama's decision support. Bespoke Labs followed with hosted Nimble v4 (9B) and v4-max (27B) on 13 Oct 2026.

          Size
          9B
          Licence
          Apache 2.0
          Run it
          ollama pull nimble
          • Matches 90.1% of reference labels on 324 held-out examples, against 93.2% for Jev 1.13 vendor reportedsource

          Decider

          Perplexity · 6 Oct 2026 · OPEN

          Perplexity's decision model reads text and images and returns a probability for every answer. It ships as Apache-2.0 open weights and as a hosted API. V1.1 (27B) halved the price on 6 Oct; V1.2 and a 4B Decider Flash followed on 20 Oct.

          Latest
          Decider V1.2 (27B) and Decider Flash V1.2 (4B)
          Price
          $0.02 (V1.2) and $0.01 (Flash) per million input tokens on OpenRouter, output free (as of 22 Oct 2026) · Compare prices
          Licence
          Apache-2.0
          • Decider V1.1-27B was the most accurate of seven decision models (94.7%) on 799 unpublished yes/no questions about coding-agent work and destructive shell commands, and the only one to pass SILT's registered calibration rule. Jev's result was inconclusive. So were the results for OpenAI's Decisions API and Laya (11 Oct 2026) independentsource

          Drex 2.0

          Nace.AI · 6 Oct 2026 · OPEN

          Drex 2.0 returns probabilities over typed answers for text, with open weights under Nace.AI's Open RAIL licence. Drex Max (13 Oct) adds images and screenshots; its 27B weights are now public under Nace.AI Open RAIL-M. Drex Max Finance followed on 01 Nov 2026 as a hosted model. The entry's date is Drex 2.0's release in Nace.AI's model table.

          Size
          Drex 2.0: 35B, about 3B active; Drex Max: dense 27B
          Price
          $0.03 per million input tokens for Drex 2.0, Drex Max, Max v1.1 and Max Finance, hosted at Nace · Compare prices
          Context
          Drex 2.0 state up to 131,072 tokens; Max Finance whole request up to 262,144 tokens
          Licence
          Drex Max weights: Nace.AI Open RAIL-M
          Access
          Drex Max supports text and images through Python on NVIDIA GPUs. CPU and Apple Silicon runtimes support text only. Max Finance API id: drex-max-finance.
          • Nace.AI reports 85.7% accuracy across 3,361 decisions on 48 held-out finance benchmarks for Drex Max Finance, with a Finance Index of 77.3. These are its own 02 Nov 2026 launch figures. vendor reportedsource

          Jebadiah v2.1

          frontier-infra · 10 Oct 2026 · OPEN

          Open decision models that read option-label probabilities in a single pass with thinking switched off: you get a pick and a confidence, not an essay. GGUF and MLX builds sit next to the full weights. Released 10 Oct 2026, written up on 16 Oct.

          Sizes
          9B and 27B
          Licence
          Apache-2.0

            Lumma-Fev-27B

            FrontiersMind · 14 Oct 2026 · OPEN

            A 27B open decision model that answers in English, Hindi, Tamil and Kannada. The makers say Jev still leads on some reasoning benchmarks.

            Size
            27B, full fine-tune
            Licence
            Apache-2.0
            • 90.7% vs Jev's 83.9% on the maker's held-out decision set vendor reportedsource

            Granite Switch 4.1

            IBM · 15 Oct 2026 · OPEN

            IBM's switchable models do chat, decisions and speech-to-text from one endpoint. 4.1 adds a general-purpose Decision adapter that speaks the /v1/systemone interface.

            Sizes
            8B and 30B
            Licence
            Apache-2.0

              TYGER

              NineNineSix · 17 Oct 2026 · OPEN

              A decision model for speech. It listens to the microphone and your text-to-speech at the same time and keeps deciding whether to speak, keep listening, yield or drop in an "mm-hm", scoring audio in 80 ms frames streamed in 320 ms hops. Built for full-duplex voice agents, with an open-source agent (tyger-s2s) on top.

              Base
              NVIDIA Nemotron 3.5 streaming ASR 0.6B
              Licence
              OpenMDW-1.1
              Works with
              Any LLM and TTS (maker's claim)

                Talos

                Tractian · Repository and weights upload: 22 Oct 2026 · OPEN

                A decision model that stands between AI agents and the controllers that run factories. Every Modbus or OPC UA request goes through one gate, where a small model decides in a single pass to allow it, answer from cache, defer it or deny it, and every decision is logged. The date is when the repo and weights went up.

                Size
                0.8B, built on Qwen3.5-0.8B
                Licence
                Apache-2.0
                • About 5 ms per decision on a laptop CPU vendor reportedsource

                Mammoth 1

                Baseten (Base Labs) · 21 Oct 2026 · OPEN

                Two open decision models from Base Labs, Baseten's research team: mammoth-1 (27B) and elephant-1 (9B), post-trained from Qwen3.5. They read text and images and return a probability for every option of each question, with all questions sharing one prefill of the state. Baseten launched them claiming the top spot on the community Jev Decision Index. On 29 Oct a third, smaller model joined: joey-1 (2B, built on Qwen3.5-2B), pitched as the fastest and cheapest.

                Sizes
                mammoth-1 27B (Qwen3.5-27B), elephant-1 9B (Qwen3.5-9B) and joey-1 2B (Qwen3.5-2B), 16,384-token context
                Licence
                MIT
                Price
                OpenRouter lists mammoth-1 at $0.10, elephant-1 at $0.035 and joey-1 at $0.01 per million input tokens, output free (as of 30 Oct 2026) · Compare prices
                • Baseten says mammoth-1 ranked #1 of 208 models on Jev Decision Index 0.4 with a full score of 71.24, and elephant-1 is the best decision model under 15B parameters (62.65) vendor reportedsource
                • In the index's current public data (Decision Index 0.4.1, generated 22 Oct 2026), mammoth-1 is first of 228 on both public-benchmark scores (75.34 skill, 81.19 raw) but third on the full score (68.44), behind GLiDE v1.2 (71.52) and jeffan-31b (69.75) independentsource
                • Baseten says joey-1 has a P50 latency of 20 ms, 5x faster than comparable decision models vendor reportedsource

                Qev 0.8B

                labqoat · Hugging Face weights upload: 20 Oct 2026 · OPEN

                A tiny open decision model that runs locally, built on Qwen3.5-0.8B and reading text and images. The date is when the weights went up on Hugging Face.

                Size
                0.8B, built on Qwen3.5-0.8B-Base, about 1.3 GB of RAM on a Mac in 8-bit (maker's figure)
                Licence
                Apache-2.0
                Runs on
                llama-server (GGUF), MLX on Apple silicon, or a System One API
                • First of 27 decision models of around 1B parameters on the public split of Benchmark Heaven (77.1%), and the fastest at a median 3.5 ms per request (batch size 1, one NVIDIA L40S), in the maker's own comparison vendor reportedsource

                Decido 1 family

                decido-ai · Weights upload: 7 Nov 2026 · OPEN

                Six English document-decision packages share the decido API. Decido-1, Max and Think use Gemma-4-26B-A4B; Fast uses Qwen3-1.7B, Ultra Qwen3-0.6B and XL DeepSeek-V4-Flash. Max distils a three-model research mixture into one checkpoint and generates up to 1,024 reasoning tokens before reading option probabilities. The Max package’s GPU serving path is still being validated.

                Variants
                Decido-1, Fast 1.7B, Ultra 0.6B, Think and Max 26B-A4B, XL
                Inputs
                English text or JSON; choice, noul and score
                Licence
                Apache-2.0 for the five Gemma/Qwen packages; MIT for the XL adapter, with separate base-model terms
                Runtime
                decido-ai package; GGUF and bf16 packages vary by variant
                Speed
                Maker reports M4 Pro CPU medians of 4.1 s for Decido-1, 0.64 s Fast and 0.41 s Ultra for a roughly 1k-token state and five questions. Think takes 19 s per question. Max reports 10.1 s p50 for five parallel questions on an A100 80 GB, or about 11 s per question on M4 Pro Metal and 28 s on CPU; no full CPU/Metal accuracy run is supplied.
                • The maker reports six-group means of 85.38 for Decido-1 on CPU, 73.01 Fast and 62.16 Ultra. The OpenJev group uses CUDA with the same GGUF, checked against a smaller CPU sample. Training includes public train splits from scored datasets; Jev's published reference run uses a different harness and 19 OpenJev tasks against Decido's 18. vendor reportedsource
                • Max reports a six-group mean of 89.23 (95% interval 88.25 to 90.15), against a published Jev 1.13 reference at 83.85. Training uses train splits from scored datasets; Jev is zero-shot and was not rerun in the same harness. Decido uses 18 OpenJev tasks against the reference’s 19. The in-domain comparison is not a general model ranking. vendor reportedsource
                • Repeating 50 GPU requests changes Max’s top answer 8% of the time. The card reports identical repeats on CPU and Metal, with answer agreement against GPU on 15 CPU and 101 Metal questions. Those small checks are not complete local accuracy evaluations. vendor reportedsource
                • Think’s reported 88.71 six-group mean is rescored from its outputs inside the Pro mixture. For 157 Kev questions the router never sent to Think, Decido-1 answers are used. The reasoning cap is hit on 46% of OpenJev questions. A 60-question CPU sample agrees with recorded GPU choices 98.3% of the time; no full CPU accuracy run is supplied. vendor reportedsource

                Arc-decide

                Arc53 (DocsGPT) · Hugging Face v0.2 upload: 11 Oct 2026 · OPEN

                The small decision model inside DocsGPT, used for quick judgements such as whether a message is a prompt injection or whether a chunk answers the question. It runs on CPU with ONNX Runtime. The date is when v0.2 went up on Hugging Face.

                Sizes
                arc-decide-0.4b-v0.2 for CPU; arc-decide-0.6b-v0.1 for NVIDIA GPUs with vLLM
                Licence
                MIT, built on Qwen3 (Apache-2.0)

                  Valen

                  Valen Team · First Hugging Face weights upload: 5 Oct 2026 · OPEN

                  Open Qwen3.5-based decision models for text, images and video. The 1.5 family adds 9B and 27B sizes alongside 0.8B, 2B and 4B. Both Jev System One and OpenAI Decisions request formats are supported. Native 1.5 weights were uploaded on 9 November; the original family dates to October.

                  Sizes
                  1.5: 0.8B, 2B, 4B, 9B and 27B; native, ONNX and GGUF formats
                  Licence
                  Apache-2.0; licence file included
                  Inputs
                  Text, images and video, with backend-specific limits
                  Runtime
                  Custom Valen plugins for native GPU serving; ONNX SDKs; custom GGUF runtime. Official unmodified llama.cpp/Ollama support is not claimed. Prebuilt GGUF 0.1.0 lacks direct video.
                  Training data
                  The 1.5 training data is not public; the earlier general-training dataset does not establish 1.5 data availability
                  Demo
                  The free API serves 1.5 in 0.8B, 2B and 4B sizes, according to the current card
                  • The maker reports public Decision Index text/vision scores of 69.01/77.85 for 1.5-4B and 74.66/82.91 for 1.5-27B. These are normalized public-track scores, not accuracy percentages or sealed-board results. The published result package records per-size runs. vendor reportedsource

                  Fovea-4B

                  Sivasuthan · Weights upload: 24 Oct 2026 · OPEN

                  An open decision model for images: give it a photo, document, receipt, chart or screenshot plus a typed question and it returns a probability for every allowed answer, served over Jev's System One API. The date is when the weights went up.

                  Size
                  4B, built on Qwen3.5-4B
                  Licence
                  Apache-2.0
                  • Scores 80.6 on the maker's own 2,360 held-out multiple-choice questions from public benchmarks, scored with ImageJevBench's formula, ahead of H2O-Lightning-4B (79.9), Imajev-4B (79.4) and Jev-Vision 8B (75.7); the maker notes this is not the ImageJevBench leaderboard vendor reportedsource

                  homi

                  egma-ai · Hugging Face weights upload: 27 Oct 2026 · OPEN

                  An open decision model that listens instead of reading: give it an audio clip and a typed question (how does the speaker feel? does the pitch rise?) and it returns a probability for every option, without a transcript. It is Qwen3-Omni-30B-A3B with frozen weights and a decision head in place of the text output. The date is when the weights went up on Hugging Face.

                  Base
                  Qwen3-Omni-30B-A3B-Instruct, frozen, with a decision head and 17M parameters of LoRA
                  Licence
                  Apache-2.0
                  Inputs
                  Audio clip plus Noul, Choice or Score questions
                  • 73.9 on VocalGrad against 63.0 for Gemini 3.8 Flash, and 83.1 on MMSU against Gemini's 85.7. Cost per 10,000 MMSU questions: an estimated $0.28 of batched GPU time on one H200 at $4.54/hour, against $14.80 in Gemini API charges at promotional pricing vendor reportedsource

                  Nimbus

                  Crele · Hugging Face weights upload: 30 Oct 2026 · OPEN

                  A decision model for live audio. You ask yes/no questions in plain English (is music playing? is someone speaking?) and it answers every 40 ms of a stream with yes, no or can't tell, real time on a laptop CPU. The date is when the weights went up on Hugging Face.

                  Size
                  About 97M parameters on the audio, plus a 0.6B text encoder (Qwen3-Embedding-0.6B) that reads each question once
                  Licence
                  Apache-2.0, code and weights
                  Inputs
                  A live audio stream plus yes/no questions; answers yes, no or cant_tell per 40 ms
                  • Says yes a median 0.24 s after a sound starts over the sounds it caught on 500 real AudioSet clips (speech 0.21 s, 97% of 181 speech onsets caught); reworded questions it never trained on scored 0.892 mean AUROC against 0.911 on its own wording vendor reportedsource

                  GLiDE

                  Fastino · Weights repository upload: 19 Oct 2026 · OPEN

                  Fastino’s decision-model family spans 0.4B, 0.8B, 2B, 9B and 27B releases. Each returns option probabilities without generated reasoning. Inputs and serving behaviour vary: the 0.4B encoder and 9B release accept text or JSON and reject images; the original 27B entry supports images. Public weights use Fastino’s community licence, and Fastino also hosts a System One API.

                  Base and size
                  27B checkpoint: Qwen3.8-27B, 52.2 GB of bf16 weights, needs one 80 GB GPU. 0.4B: an Ettin encoder derivative, 0.81 GB of weights (1.77 GB tested peak GPU memory). 9B: 15.90 GB of weights (18.92 GB tested peak)
                  Licence
                  Fastino community licence (not a standard open-source licence)
                  Access
                  Weights on Hugging Face, or Fastino's hosted System One API
                  Family
                  Five sizes announced 5 Nov 2026: 0.4B, 0.8B, 2B, 9B and 27B
                  Inputs
                  Checkpoint-dependent: 0.4B and 9B accept text or JSON and reject images; original 27B supports images
                  • Fastino says GLiDE 1.2 is #1 of 229 models on Decision Index 0.4.1 (as of 22 Oct 2026) vendor reportedsource
                  • In the index's public data (release 0.4.1, generated 22 Oct 2026), GLiDE 1.2 is first of 228 entries on the full score (71.52), ahead of jeffan-31b (69.75) and mammoth-1 (68.44); mammoth-1 leads both public-benchmark scores. In the index's 29 Oct data, GLiDE is second of 247, behind KnowLine 31B Gen1 (71.86) independentsource

                  UltraBERT Curation

                  Daniel van Strien · 28 Oct 2026 · OPEN

                  A 380M-parameter decision model for data curation: give it a web page, prompt, maths problem or library record and typed questions (topic, format, educational value, difficulty) and it returns a probability for every option. The release centres on its recipe: the data-building and training scripts are public, with source and labeller/licence metadata where known, and 516,964 of the 535,730 training rows are released (web text omitted).

                  Size
                  380M parameters, UltraBERT-380M encoder plus a GLiClass scoring head
                  Licence
                  Apache-2.0
                  Open data
                  516,964 of 535,730 training rows released, plus 1,020,000 FineWeb pages scored with it

                    KnowLine

                    PelaAI · First Hugging Face family release: 7 Oct 2026 · OPEN

                    A fast-moving family of open decision models from PelaAI, trained in an agent-driven data loop, with English and Chinese in mind: from 0.8B up to 35B-A3B, with new generations posted every few days. The newest big one, KnowLine-31B-Gen1 on a Gemma 4 base, went up on 23 Oct. The date is the first family release on Hugging Face (4B-Gen1).

                    Sizes
                    4B through Gen5.5; 26B-A4B through Gen2.5; 35B-A3B through Gen1.5; 0.8B, 2B, 9B and 31B (Gemma 4 base) at Gen1; community GGUF builds
                    Licence
                    Apache-2.0
                    Languages
                    English and Chinese
                    • In the Decision Index's 29 Oct 2026 data, KnowLine 31B Gen1 is first of 247 on the full score (71.86), ahead of GLiDE 1.2 (71.52) independentsource
                    • PelaAI reports 0.4% of answers changed by an instruction planted in the state, 5.3% with injection templates unseen in training vendor reportedsource

                    Ollama v0.35

                    Ollama · 28 Sep 2026 · RUNTIME

                    Ollama added native decision models through /v1/systemone, based on TypeSafe's Jev API, so you can run one on your own machine. It shipped with Nimble and Tev1.

                    Endpoint
                    /v1/systemone
                    Question types
                    choice, noul, score
                    Launch models
                    Nimble, Tev1

                      SemIf (formerly OpenJev)

                      TheoLeeCJ · COMMUNITY

                      Reproduces Jev's interface pattern with open models: it reads typed option probabilities directly from a model, with no answer sentence and no decoding loop. Runs in your browser, or at home on a GPU, Apple Silicon or CPU. Independent of TypeSafe, and it does not reproduce Jev's model or training.

                      Availability
                      Runs in the browser
                      Models
                      Qwen3 0.6B, MiniCPM5 2B or Qwen3.5 4B, as pinned GGUF builds through wllama
                      • Checked against its own README on 2 Oct 2026 code verifiedsource
                      • On JevBench v1.8.6, published 01 Nov 2026, SemIf (formerly OpenJev, Qwen3.5-4B) ranks #143 at 55.4 Capability, with 27.1 Intelligence and 83.6 Calibration. Jev 1.13.0 is the unranked reference at 77.1 Capability. independentsource

                      bnsd55/jevmlx

                      bnsd55 · COMMUNITY

                      Parallel constrained decisions for local models through mlx-lm on Apple Silicon: the schema is a set of typed fields, the context is prefilled once and broadcast across one batch row per field. MIT licensed. Large answer sets may be chunked rather than done in a single pass.

                      Availability
                      Open source
                      • Checked against its own code and README on 18 Sep 2026 code verifiedsource

                      kw2828/OpenJev

                      kw2828 · COMMUNITY

                      A browser and local playground for decision experiments on memory, uncertainty and control, using Qwen-family models and returning option probabilities. MIT licensed. Its README states it is independent of Jev, of openjev.com and of zhihz/openjev.

                      Availability
                      Open source
                      • Checked against its own code and README on 18 Sep 2026 code verifiedsource

                      akash-kamat/system-one-gemma

                      akash-kamat · COMMUNITY

                      Gemma 3 270M with a scoring head, producing a decision in a single forward pass with no text generation. Code and adapter weights are publicly readable, but the repository carries no licence, so it is not open source in the legal sense. The Gemma base weights remain under their own separate terms.

                      Availability
                      Source available; no licence found as of 18 Sep 2026
                      Model
                      270M (Gemma 3 backbone)
                      • Checked against its own code and README on 18 Sep 2026 code verifiedsource

                      leofmarciano/groot

                      leofmarciano · COMMUNITY

                      Groot 1 S, a 149M-parameter open typed-decision model that speaks the System One request format and reads states of up to 64k tokens in the maker's tests. Its forward pass also ships in the Bend language.

                      Size
                      149.3M
                      Licence
                      Apache-2.0
                      • 75.2% vs Jev's 73.7% on the full 2,000-question test split of the public LocalLLaMA/typed-decisions set, run by the maker, with a Brier score under half of Jev's vendor reportedsource

                      jwuthri-cloud/SelfJev

                      jwuthri-cloud · COMMUNITY

                      A self-hosted decision model with a Jev-compatible API: you run the server on your own GPU, and a 230 MB vision adapter on Qwen3.5-4B reads text and images. Python SDK, server and fine-tuning in one package.

                      Base
                      Qwen3.5-4B
                      Licence
                      Apache-2.0 (code)

                        prismhq/jev-router

                        prismhq · TOOLING

                        A LiteLLM-based router with an optional Jev decision backend: when a TypeSafe API key is configured it can use Jev to pick a model per request, and otherwise falls back to its own rules-based decider. MIT licensed.

                        Availability
                        Open source
                        • Checked against its own code and README on 18 Sep 2026 code verifiedsource

                        mizorewww/laya-mlx

                        mizorewww · TOOLING

                        Runs the open Laya decision models natively on Apple Silicon with MLX: no PyTorch, no cloud API, zero output tokens. Its demo plays Snake, calling Laya for every move with a safety layer that can override unsafe ones. Apache-2.0, and more starred than any project on our list except browser-use's jev-ultrafast.

                        Stars
                        6,994 on GitHub (GitHub API, 22 Oct 2026)
                        Licence
                        Apache-2.0
                        • 13.4 ms median for one short English typed decision, 7.4 ms with the multilingual checkpoint, on the maintainer's M3 Max vendor reportedsource

                        Hume Audio Decisions API

                        Hume AI · 2 Nov 2026 · HOSTED

                        Hume's hosted model answers questions about speech and sound with probabilities. Send one MP3 or WAV recording, 5 seconds to 5 minutes long, with questions in plain language. It supports yes/no, choice, score and time-span answers, and returns no transcript. Hume says the probabilities estimate how human raters would respond.

                        Access
                        Playground; request API access through Hume's waitlist
                        Inputs
                        One MP3 or WAV per request, 5 seconds to 5 minutes; the model hears 16 kHz mono audio
                        Price
                        $0.47 per million input tokens (audio, questions and context); answers not billed. Hume's billing docs, checked 03 Nov 2026 · Compare prices
                        SDKs
                        Python hume-audio-decisions and TypeScript @humeai/audio-decisions; Python SDK code MIT
                        Questions
                        Several questions can share one recording; the overview demonstrates yes/no and score questions in one request
                        • Hume reports 70.7% agreement with a human panel's average judgment, against 56.5% for an individual-rater baseline, in its initial evaluation. vendor reportedsource
                        • On Hume's product-page chart, its model averages 0.82 across 10 benchmarks at 0.23 seconds median latency per screen. The chart gives Gemini 3.8 Flash 78%, Qwen3.8-Omni-Flash 76% and Inkling-Small 67%; it names MMAU, ParaPair and EmphAssess among the benchmarks. vendor reportedsource

                        Zoom Decisions API

                        Zoom · 19 Oct 2026 · HOSTED

                        Zoom's hosted Decisions API and Decisions API Pro accept text, images or both. Define several questions about the same input and get structured answers in one call for condition checks, option selection and scoring.

                        Models
                        Decisions API and Decisions API Pro
                        Price
                        $0.042 per million tokens for Decisions API; $0.10 for Pro, per Zoom's product page checked 03 Nov 2026 · Compare prices
                        Endpoint
                        POST /v2/aiservices/decisions/decide
                        Access
                        Zoom AI Services portal and playground; sign-up or login required
                        • Zoom reports 83.9% overall accuracy for Decisions API Pro on a comparison it says uses JevBench and ImajevBench. Its product page says Pro leads the tested models but gives no dated per-model results table. vendor reportedsource

                        LingDT-Decision-1.0

                        Ant Digital Technologies (蚂蚁数科) · 22 Oct 2026 · HOSTED

                        Ant Digital Technologies' System One model for choosing answers to business questions, including native multi-select and decisions ordered by dependencies. IT之家 reported its 22 Oct 2026 launch in 4B and 27B versions for customer service, risk and finance. Ant's current DTMaaS listing describes the lingdt-decision-1.0 endpoint as a 4B test model.

                        Sizes
                        4B and 27B announced, per IT之家; the current DTMaaS endpoint identifies itself as 4B
                        Try it
                        Open the DTMaaS model page and its API guide. Use an API key with POST maas-api.antdigital.com/v1/systemone and model lingdt-decision-1.0; send state, questions and optional DAG dependencies
                        Limits
                        Ant lists 32 questions per request, 255 options, DAG depth 3 and a default 60 requests per minute. Its English and Chinese descriptions disagree on whether the 16K context limit applies per question or per request.
                        Price
                        Ant lists ¥0 per million input and output tokens, with an original input rate of ¥0.20 per million tokens. Checked 04 Nov 2026. The rate is for the 4B test endpoint during a free trial; no trial end date was established. · Compare prices
                        Compare
                        Jev and Microsoft-Decision-1 are hosted alternatives, each listed at $0.042 per million input tokens. LingDT's free-trial price covers a 4B test endpoint; these rates do not compare accuracy
                        • Across 23 open benchmarks, Ant says LingDT-Decision-1.0 beats Microsoft-Decision-1 and Jev 1.13, with the 27B version most accurate in its size class. These are Ant's results as reported by IT之家, not an independent comparison. vendor reportedsource
                        • IT之家 reports Ant's claim of over 90% fewer tokens and up to 10x faster responses than LLMs in its customer-service, risk and finance tests. vendor reportedsource

                        Ru-Jev

                        besktech (beskvladimir-create) · First Hugging Face repository creation: 1 Nov 2026 · OPEN

                        A Russian-first typed-decision model built on mmBERT-base (307M), with a separate scoring head. It runs on CPU and supports yes/no, choice and ordinal scales. The maker says it is unaffiliated with TypeSafe AI and was not trained on Jev outputs. The v1.3 card documents improved option-wording robustness and withdraws an earlier calibration comparison.

                        Size
                        307M (mmBERT-base)
                        Licence
                        Code MIT; weights tagged MIT on Hugging Face
                        Run it
                        Load the backbone, head.safetensors and calibration.json using the Hugging Face card's Python example; the standard inference widget cannot load the separate head
                        Release date
                        First Hugging Face repository creation: 01 Nov 2026; v1.3 card checked 05 Nov 2026
                        Calibration
                        Optional label-specific additive biases can change the selected answer; temperature alone cannot
                        • For v1.3, the maker reports 0.823 micro accuracy and 0.0185 ECE on 13,373 decisions, with temperature fitted on a disjoint half. Its 0.0159 ECE fitted and scored on the same data is in-sample. vendor reportedsource
                        • On six tasks with identical rows and option wordings, v1.1 and v1.3 each get 8,120 of 10,157 decisions right (0.7994). The card withdraws its claim of better calibration after temperature fitting: split variation reverses the comparison. Word-sense questions supply 84% of these rows. vendor reportedsource
                        • On the fifteen routing categories whose jargon labels do not coincide with training wordings, the maker reports accuracy rising from 0.624 for v1.1 to 0.838 for v1.3. Each recipe was run once; this is not a multi-seed result. vendor reportedsource
                        • The maker reports v1.3 accuracy 0.568 rising to 0.640 on news rubrics under label-specific bias fitting; v1.1 reaches 0.673 under the same fit. The fitted biases belong to that option set and do not transfer to another set. This is a calibration-tool update, without a new backbone release. vendor reportedsource

                        Intern-Decision

                        InternLM · First Hugging Face upload: 26 Sep 2026 · OPEN

                        Send a shared state, named questions and optional images to these multimodal models. A single forward pass returns an answer distribution for every question, without generating text. The Qwen3.5-based family has 0.8B, 2B and 4B sizes.

                        Sizes
                        0.8B, 2B and 4B
                        Base
                        Qwen3.5; the 4B model uses Qwen3.5-4B
                        Licence
                        Apache-2.0
                        Inputs
                        Text and images
                        • InternLM reports a seven-benchmark average of 90.02 for Intern-Decision-4B against 88.74 for Jev, with Brier / ECE of 0.347 / 0.065 against 0.358 / 0.095. vendor reportedsource
                        • The model card reports mean latency of 44.16 ms for the 4B on one RTX 4090, against 109.70 ms for Jev. The local and network paths differ, so these timings are not like for like and depend on hardware and workload. vendor reportedsource

                        MiniCPM-OCR Jev

                        OpenBMB · First Hugging Face upload: 23 Oct 2026 · OPEN

                        This 2B specialist scores whether a candidate OCR reading matches a document region. It handles text, formulas and tables, returning a score from 0 to 1. Qwen3.5-2B supplies the backbone; a binary classification head replaces its language head. Scores can help select among OCR engines or route uncertain regions to a person.

                        Size
                        2B
                        Base
                        Qwen3.5-2B
                        Licence
                        Apache-2.0
                        Access
                        Open weights in BF16, AWQ, GPTQ and GGUF; a free API on ModelBest's platform
                        • OpenBMB reports decision AUROC ×100 of 93.6 on its JevOCRBench, against 90.1 for a row named JEV-35B-A3B and 93.8 for Qwen3.5-397B-A17B. The card does not identify JEV-35B-A3B further. vendor reportedsource
                        • Across four OCR parsers on the same 200 samples with manually labelled readings, OpenBMB reports AUROC ×100 from 91.9 to 93.4. These are its own parser and sample combinations. vendor reportedsource

                        hs-decide-1-flash

                        Vectorize (Hindsight) · 3 Nov 2026 · OPEN

                        Vectorize's Hindsight team fine-tuned this 0.8B model from Qwen3.5-0.8B for agent memory. It returns probabilities for choice, score and yes/no questions in one pass. Hindsight first tried these judgments with Jev, then trained its own model to check whether facts are new and evidence is enough. It uses the same System One request shape.

                        Size
                        0.8B
                        Base
                        Qwen/Qwen3.5-0.8B
                        Licence
                        Apache-2.0
                        Inputs
                        Text and structured state
                        Languages
                        English, Spanish, French, German, Portuguese, Japanese, Korean and Chinese
                        Context
                        65,536 tokens per request (trained)
                        Price
                        $0.02 per million input tokens on Hindsight Inference; input only · Compare prices
                        Access
                        Open weights; vLLM plugin or Transformers on CPU, Apple Silicon and supported GPUs; hosted POST /v1/systemone
                        • In Hindsight's own 1.2.0 evaluation, quality rises for six of seven LLMs. glm-5.3-flash goes from 73.8 to 87.1 and deepseek-v4.1-flash from 81.9 to 85.1; gemini-3.1-flash-lite goes from 87.1 to 86.6. That model is also the judge, so its rows are self-graded. Costs fall for five LLMs. vendor reportedsource
                        • glm-5.3-flash with the decision model scores 87.1 at $7.72 per thousand cases, against 89.0 at $147 for gemini-3.8-flash alone. Costs use list prices and an equal mix of four memory operations. vendor reportedsource
                        • Median decision-model latency is 167 ms, with 350 ms at p90. The replaced LLM calls had median latencies of 1 to 7 seconds, depending on the model. vendor reportedsource
                        • Reflect costs 4.6x less with gemini-3.8-flash, while quality drops from 94.1 to 91.2. With gemini-3.1-flash-lite, reflect quality drops from 94.1 to 85.3. vendor reportedsource
                        • Against three other 0.8B models, its mean across eight benchmarks is 75.6, ahead of 74.5, 73.4 and 66.6. On the public Decision Index it trails StartLux-Decision 0.8B Instant, 36.1 to 53.8. vendor reportedsource
                        • Across its evaluation, Hindsight reports 3.1 LLM calls per case with the decision model, against 4.5 before. This is an evaluation-wide mean; individual memory operations and workloads differ. vendor reportedsource

                        Smaug-Decisions

                        Abacus.AI · Maker blog announcement: 2 Nov 2026 · OPEN

                        Abacus.AI's 4B decision model answers a typed question about audio, an image or text with a probability per option in one pass. It is a Gemma 4 E4B-it fine-tune. The family includes a 744M audio model and a LiteRT build for phones. Each 4B request takes one audio clip up to 30 seconds or one image, with up to 20 options.

                        Size
                        4B effective, 8.6B stored; 744M audio tier
                        Base
                        google/gemma-4-E4B-it; google/embeddinggemma-2 for the audio tier
                        Licence
                        Apache-2.0
                        Inputs
                        Audio, images and text; 2 to 20 options
                        Formats
                        Transformers; LiteRT-LM; Core ML int8 for the audio tier
                        • On Abacus.AI's 6,671-item Earshot benchmark, the 4B scores 60.1 audio skill with ECE 0.069. Gemini 4 Argon scores 59.4 with ECE 0.123, and Gemini 3.8 Flash 50.5 with ECE 0.204. The 0.7B audio tier scores 53.0 with ECE 0.086. vendor reportedsource
                        • Using the 0.7B audio tier first and escalating below 0.9 matches the 4B's 60.1 audio skill at 130 ms mean latency instead of 210 ms in Abacus.AI's run. vendor reportedsource
                        • Abacus.AI reports 57.9 on public Decision Index images and 56.6 on text. These are its own runs, not leaderboard submissions. vendor reportedsource
                        • The 3.45 GB LiteRT build scores 59.4 audio skill in a PyTorch replica of its quantized weights. Abacus.AI measures about 0.6 seconds per text decision on an iPhone 14 Pro Max. vendor reportedsource

                        REAX 1.3

                        REAX · 3 Nov 2026 · OPEN

                        REAX 1.3 runs two model parts on one GPU and averages their per-option probabilities 50/50. One blends a Bittensor subnet 92 miner fine-tune with KnowLine; the other blends a miner fine-tune from Mammoth-1's lineage with Decision 1.0's d3-ultra. Its interface accepts Jev-style requests. The hosted service at decisionmodels.io and the Hugging Face account decisionmodels belong to a separate business unrelated to decisionmodels.ai.

                        Licence
                        Apache-2.0 for the blended work, subject to preserved upstream licences and notices; REAX Engine is MIT
                        Weights
                        About 115 GB in FP8; reference hardware is one RTX PRO 6000 Blackwell 96 GB
                        Inputs
                        Text; noul, choice and score questions
                        Access
                        Open Hugging Face weights and REAX Engine reax13 mode
                        Local input cap
                        32,000 proxy tokens, calculated from compact request JSON characters divided by four, rounded down; larger requests are refused.
                        • REAX reports 73.71 on all 140,178 scoreable public Decision Index 0.3 requests. Counting the one request above the released engine's input cap as refused gives 73.70. These are internal measurements, not official leaderboard scores. vendor reportedsource
                        • On 3,478 public items answered by all eight models, REAX reports 69.5 against 68.8 for d3-ultra, within noise, and 67.4 for KnowLine. The second draw was added after a partial result was known. The public subset cannot establish an official Full-score ranking. vendor reportedsource
                        • On a uniform 1,000-call sample, REAX measures 207 ms median and 655 ms mean latency, one request at a time on one RTX PRO 6000. Long multi-question requests can take minutes. vendor reportedsource

                        K-Decision-9B

                        ONYULTEA · First Hugging Face upload: 3 Nov 2026 · OPEN

                        A Korean-specialised 9B decision model based on Qwen3.5-9B, trained with int8 LoRA at rank 32. It reads a state and typed questions, then returns probabilities over the options in one forward pass. The first public release supports choice and yes/no questions through a Jev-compatible /v1/systemone server.

                        Size
                        9B
                        Base
                        Qwen/Qwen3.5-9B
                        Licence
                        Apache-2.0, declared for the model weights
                        Inputs
                        Text; choice questions with 2 to 26 options and yes/no questions
                        Language
                        Korean-specialised; the model card also tags English
                        Limits
                        State up to 6,000 characters; unsupported requests return HTTP 422
                        Access
                        Public model.safetensors weights and serving code
                        • ONYULTEA reports 0.866 accuracy on a five-task KoBEST conversion with 2,600 items, and 0.635 on 3,000 korean-jev-decision-index items. Its LocalLLaMA typed-decisions score of 0.818 is labelled fitted. vendor reportedsource
                        • On the public Decision Index 0.3 suite, ONYULTEA reports index 30.7, raw 44.8 and 168 ms p50 latency. It says training and serving used one 24 GB consumer GPU. vendor reportedsource
                        • The card reports KMMLU accuracy 45.4%, against a 23.4% zero-shot base result. Its 8 November history calls this a label-conversion correction to an earlier approximately 30% figure, not a new weight release. vendor reportedsource

                        Reflex

                        Morph · OpenRouter listing date: 3 Nov 2026 · HOSTED

                        Morph's hosted 27B decision model is based on Qwen3.5. It answers choice, yes/no and score questions about text, JSON or images, returning probabilities without generating text. The System One endpoint supports several questions about a shared state, with automatic prefix caching for repeated input.

                        Size
                        27B; Qwen3.5 base, according to Morph
                        Inputs
                        Text, JSON and images; PNG, JPEG and WebP as inline base64 data URLs
                        Context
                        65,536 tokens
                        Price
                        $0.042 per million uncached input tokens; $0.008 cached; output free · Compare prices
                        Images
                        Up to 16 per request, 8 MB each; remote image URLs are unsupported
                        Access
                        POST /v1/systemone on Morph; morph/reflex on OpenRouter
                        • Morph reports five production calls with a satellite frame, a blank image and repeat inputs. Repeated inputs reused 1,216 of 1,328 tokens (91.6%); the first satellite call took 890 ms and its repeat 220 ms. Switching to the blank image changed the decision and missed the cache. These are observed calls, not latency guarantees. vendor reportedsource

                        Saif 0.8B Lightning

                        GyrTechnology · v0.3 weight update: 7 Nov 2026 · OPEN

                        A 0.8B decision model fine-tuned from Qwen3.5-0.8B. It reads a shared state and isolated question segments in one forward pass, returning probabilities for choice, yes/no and score questions. The release includes serving code and weights without a text-generation head. Its non-commercial licence limits how it can be used.

                        Size
                        0.8B; about 1.5 GB in bf16
                        Base
                        Qwen/Qwen3.5-0.8B
                        Licence
                        CC BY-NC 4.0; non-commercial
                        Inputs
                        Text and JSON state; choice, noul and score questions
                        Access
                        Public decoder and decision-row weights, Python runtime and Decision Index engine
                        • GyrTechnology reports 47.75 chance-corrected skill and 60.73 raw on the public Decision Index 0.3 suite, with all 140,178 requests answered. Median/mean/p80 latency is 18/54/30 ms on one RTX 5070 Ti, one request at a time. These are maker results; the earlier v0.1 scored 42.79. vendor reportedsource

                        Horopter beta-3

                        Fight Fire with Fire Robotics · Beta-3 release; first release 20 Oct 2026: 4 Nov 2026 · OPEN

                        An encoder-only decision model family built on Ettin, with 0.4B and 1B sizes. It returns typed answers alongside evidence spans, a relation to the state and an abstention estimate. It encodes and caches the state before seeing questions. Beta-3 adds non-decisive rule outcomes and a field-extraction adapter; the first release was 20 Oct 2026.

                        Size
                        0.4B and 1B
                        Base
                        Ettin encoders from jhu-clsp
                        Licence
                        Weights, data recipe and docs: CC BY-NC-SA 4.0; code: MIT
                        Inputs
                        English text or JSON state; up to 2,048 state tokens
                        Access
                        Public weights; Python runtime; /v1/systemone, /v1/clairic and combined /v1/horopter endpoints
                        Training restriction
                        Training includes TypeSafe Jev API outputs. The card says TypeSafe terms prohibit using them to imitate its model or build a competing service.
                        • The maker reports ShARC four-way accuracy of 82.3 for the 1B beta-3 release, against 54.3 for its first release. ShARC training data is included, so the dev set is held out within the same distribution. On JevBench hard, the 1B scores 40.5 against 64.0 for clef-flash. Generated-policy results do not establish the same performance on real rule text. vendor reportedsource

                        TS-PRGuard

                        typestrict (Lucas Duarte) · Public release: 4 Nov 2026 · OPEN

                        A 150M pull-request decision model built on TS-Ettin-150M. It asks five fixed questions about a diff, covering description agreement, review difficulty, compatibility, test coverage and security. Its 8-bit ONNX package runs the questions in one CPU pass. The questions use choice and yes/no answers; this is a specialist package.

                        Size
                        150M
                        Base
                        typestrict/TS-Ettin-150M
                        Licence
                        Apache-2.0 tag on the model card
                        Inputs
                        English pull-request descriptions and code changes
                        Access
                        164,505,784-byte ONNX file, tokenizer and decision_ai.json; ONNX Runtime or decision_ai for Flutter
                        • The maker reports wins on four of five questions under its refund calculation, which combines four metrics and bootstrap intervals. On description agreement, macro-F1 is 0.928 against Jev 0.807 over 436 held-out examples. On compatibility, Jev is ahead: 0.910 against 0.870 over 2,000 examples. These are task-specific vendor results. vendor reportedsource

                        wps-decision-1

                        Kingsoft Office · Public release: 4 Nov 2026 · OPEN

                        A d3-flash fine-tune with typed choice, yes/no and score answers for text, JSON, images and videos. It keeps the Qwen3.5-9B multimodal architecture and decision readout. The bundled Transformers runtime extends score questions to 255 ordered levels; the documented vLLM build keeps the upstream 10-level limit.

                        Size
                        8.394B, including a 0.456B vision encoder
                        Licence
                        Apache-2.0; LICENSE and NOTICE shipped
                        Inputs
                        Text, JSON, images and videos
                        Context
                        262,144 configured positions; this is not a GPU memory guarantee
                        Access
                        Full BF16 weights and FP32 readout; Transformers or /v1/systemone on the pinned vLLM nightly
                        • The card reports a validated deployment on one RTX 5090 with a pinned vLLM nightly and recorded dependencies. Each question gets its own forward pass, batched by the runtime. It publishes no task-accuracy benchmark. vendor reportedsource

                        d3-mini-agentcode

                        stonefish-labs · Public release: 4 Nov 2026 · PRE-RELEASE

                        A pre-release 4B d3-mini fine-tune for reviewing code written or run by an agent. It reads the task, repository baseline, behaviour summary and change, then returns three fixed decisions about class, intent and scope. The static extractor never runs the code being inspected. It is intended to rank items for further review.

                        Size
                        4B
                        Licence
                        Apache-2.0; LICENSE and NOTICE shipped
                        Inputs
                        Text task and diff or executed snippet; truncated above 8,192 tokens
                        Access
                        Merged weights, readout, adapter, extractor, frozen questions and thresholds
                        • At its frozen thresholds, the maker reports 458 of 510 positives found across 14 languages and shells, with 11 of 2,150 real items and 1 of 560 authored benign controls flagged. On an independently written agent-diff set it finds 21 of 22 positives with 0 of 172 negatives flagged. These evaluations were run by the maker. vendor reportedsource
                        • Training positives came from one writer model; recall falls on other writers. Unrequested personal data in request headers is mostly missed (1 of 40). The release is a pre-release and is not a sole security gate. vendor reportedsource

                        Lory

                        eltokh7 · Public release: 4 Nov 2026 · OPEN

                        A public-preview family for simulated survey respondents, fine-tuned from Kev at 4B and 27B. It returns option probabilities from persona traits and a question, with training intended to make answers respond to prices, odds and payoffs. The 27B release has merged weights; 4B has a LoRA adapter and pointer head. Its tests check economic consistency, with no validation against real people.

                        Size
                        4B and 27B
                        Licence
                        Apache-2.0 tags on both model cards
                        Inputs
                        English personas and survey questions, using US-style amounts and settings
                        Access
                        kev.serve at the pinned Kev revision; /v1/systemone; EDSL survey adapter included
                        • The maker reports Lory-27B scoring 88 on its own nine-family DLS test against Kev-27B 71, and 92 against 90 on 513 contrasts written separately by GPT-6.1-sol. The blind test measures direction of movement, not its size. Each size has one training seed. vendor reportedsource
                        • Lory-4B scores 79 on DLS and 81 on the blind test, against released Kev-4B 53 and 67. Its framing-invariance score is 56/100, against 66/100 for Lory-27B. Economic consistency does not establish realistic human responses. vendor reportedsource

                        Glimmer System One

                        Aryan Srivastava · Public release: 4 Nov 2026 · OPEN HEADS

                        A visual-inspection decision model built around Muse Glimmer 30B. The release supplies two small logistic heads for a fixed manufacturing-defect question, plus a temperature for zero-shot scoring; the backbone is downloaded separately. A head must stay paired with its exact prompt, image resize and object noun.

                        Size
                        30B backbone; each logistic head file is 134,696 bytes
                        Licence
                        Heads and code Apache-2.0; MVTec AD data CC BY-NC-SA 4.0, research use only
                        Inputs
                        English questions and part images resized to a 448-pixel long side
                        Access
                        Public heads and calibration files; Muse Glimmer 30B required separately; code and demo on GitHub
                        • The maker reports AUROC 0.962 and 90.2% accuracy on the held-out 866-image half of the same 15 MVTec AD products used to train the head. The layer-13 head reports 0.954 and 88.3%. These are known-product tests, not general defect-detection accuracy. vendor reportedsource
                        • The card reports 45 ms per image batched on one H100 for the full model and 21 ms for a truncated layer-13 benchmark. The supplied server still runs the full depth, so loading the early head alone does not give the 21 ms path. vendor reportedsource

                        laya-slotjudge-m46

                        Christophe Cruz, Hussam Ghanem and Hocine Cherifi · Model-card release: 4 Nov 2026 · OPEN

                        A multilingual Laya fine-tune that chooses a proposed value for a dialogue slot or answers not specified. It needs candidate values from another component and does not extract spans. The released seed was selected on development data from three training seeds; its card reports results for 46 training languages and five held-out languages.

                        Size
                        About 322M, according to the card
                        Licence
                        CC BY-SA 4.0 weights
                        Inputs
                        Dialogue message, context and candidate values; 1,024 input tokens and 48 per option
                        Access
                        Laya runtime; public model.safetensors, configuration and calibration files
                        • On MTOP across six languages, the authors report slot F1 0.953 with oracle candidate lists and 0.488 with real proposers, whose candidate recall is 0.578. With real lists on MTOP and MASSIVE, ECE remains about 0.15 to 0.17. Thresholds and temperature need fitting to the user's own data. vendor reportedsource
                        • At the card's 1% target risk, the development-set threshold keeps 60% of correct fills with oracle lists but only 3% with real lists. These are development-set operating points, not guaranteed test error rates. vendor reportedsource

                        Grayson

                        Finic · HOSTED

                        Finic's hosted fraud and risk decision model returns probabilities for yes/no, single-choice and multiple-choice questions. The ask endpoint uses grayson-1 and accepts structured case data or free-text context. The separate score endpoint builds a 0 to 1,000 risk score from a scoring model calibrated with labelled records. An HN comment surfaced it on 04 Nov 2026; its release date is unconfirmed.

                        Inputs
                        Structured data and free-text context
                        Context
                        32,768 input tokens per request
                        Questions
                        1 to 128 per ask request; choice and multi_choice have 2 to 255 options
                        Price
                        $0.035 per million input tokens for ask and score; creating and calibrating scoring models is free · Compare prices
                        Access
                        Hosted POST /v1/ask with model grayson-1; no public weights confirmed
                        • Finic documents identical answers for an identical request, while changes to wording, option order, data, context or key order make a different request. It also says adding or changing another question can move numerical values slightly, under one percentage point on average. This is the vendor's contract, not an independently reproduced determinism test. vendor reportedsource

                        Cicero

                        Butler Compute · Hugging Face package release: 5 Nov 2026 · OPEN

                        A Qwen3.5-35B-A3B decision fine-tune with 3B active parameters. It reads text, chat or up to four images and answers typed questions from option-letter logits, without generating an answer. BF16 and NVFP4 packages are public under Apache-2.0; the maker identifies NVFP4 as its production format.

                        Size
                        35B total parameters, 3B active
                        Inputs
                        Text, chat, up to 4 images
                        Limits
                        131,072-token context; up to 64 questions and 255 choice options
                        Licence
                        Apache-2.0
                        • The maker reports 71.33 on the public JDI 0.4.1 suite from its own run. This is not the full index score or an independent reproduction. Its 41 ms median latency has no hardware or workload specification in the card. vendor reportedsource

                        Adjudex

                        NewsBang · 9B v5 and 0.8B v5 weight releases: 8 Nov 2026 · OPEN

                        Qwen3.5 typed-decision models in 9B v5 and 0.8B v5 packages, with a separate 255-option head and noncausal attention in their full-attention layers. Both include merged weights and the Decider-derived System One server. Overlong question branches are refused instead of truncated.

                        Sizes
                        9B v5 and 0.8B v5; BF16 decision heads
                        Context
                        8,192 tokens per question branch
                        Licence
                        Apache-2.0; serving code credited in NOTICE
                        • The maker reports public Decision Index 0.3 skill 69.28 and raw 76.81 for 9B v5 over 140,620 requests. All 345 overlength HTTP 422 refusals count as wrong. The run uses BF16 CUDA on one A800 80 GB per server process. vendor reportedsource
                        • For 0.8B v5, the maker reports skill 54.69 and raw 66.33 on 140,620 public-suite requests, including 345 refusals counted wrong, using BF16 on one A800 80 GB per server process. The preceding v4 card reported skill 55.10; this is a lower score. vendor reportedsource

                        kai-decision / K-IM-Deiction

                        Songkai · First Hugging Face package release: 5 Nov 2026 · OPEN

                        A Qwen3.5-0.8B model with seven fixed heads for Chinese enterprise group chats. One pass labels category, sentiment, importance, urgency, intensity, attention and to-dos. K-IM-Deiction V2 ships merged weights, an optional adapter and an MLX port. The private chat data is not released.

                        Package
                        Merged Qwen3.5-0.8B V2 backbone, seven heads and calibration files; optional rank-64 adapter and native MLX edition
                        Inputs
                        Text windows, left-truncated to 512 tokens
                        Licence
                        Apache-2.0
                        Newer package
                        V2 weights uploaded 6 Nov 2026; MLX edition 7 Nov 2026
                        • On 1,000 windows from seven unseen groups, the maker reports category macro-F1 0.611 across seven classes, or 0.673 after excluding classes with support below ten. Needs-attention AUC is 0.822; binary-head ECE is 0.053 and 0.069. Labels come from GLM-5.3, with a second teacher used for agreement checks. Median latency is 41.0 ms on an RTX 4090 D at batch one. The earlier DeepSeek comparison was not rerun for V2. vendor reportedsource

                        Kev LUX Places

                        Yale Cultural Heritage AI · Hugging Face package release: 4 Nov 2026 · OPEN

                        Two Kev-4B adapters check whether linked authority records describe the same place and whether a declared parent contains a child place. They supply pointer heads and calibration temperatures, with the Qwen3.5-4B base downloaded separately. The part-of adapter continues training from the equivalence adapter.

                        Inputs
                        Rendered authority records and fixed yes/no statements
                        Package
                        LoRA adapters and pointer heads; separate 4B base
                        Licence
                        Apache-2.0 tags on both cards
                        • The equivalence maker reports balanced accuracy 0.940 on 499 held-out decisions over 150 places. Labels retain agreement between Gemini and Jev and were not checked by people, so this measures agreement with machine consensus. vendor reportedsource
                        • The part-of card reports balanced accuracy 0.983 and Brier 0.014. Only six real negative links appear in its test split; synthetic negatives and authority hierarchy evidence limit conclusions about rare real errors. vendor reportedsource

                        d1-qwen-0.6b

                        Grizzlykw · Hugging Face package release: 4 Nov 2026 · OPEN

                        An independent Qwen3-0.6B text decision starter with a frozen backbone and a trained 1,025-parameter compatibility head. It uses no LiquidAI weights. Each question-option pair repeats the state in its own input row, so candidate count adds work and memory. The package includes weights, code, splits and a training report.

                        Inputs
                        Text or JSON; choice, independent multiple choice, yes/no and score
                        Context
                        512 tokens per candidate row; longer input raises an error
                        Licence
                        Apache-2.0
                        • The saved report gives trained accuracy 0.5715 versus baseline 0.386 on 2,000 test decisions across Banking77, SST5, GoEmotions, BoolQ and AG News. The checkpoint and temperature were selected on a separate calibration split. These task results do not validate arbitrary questions or other domains. vendor reportedsource

                        SecJev-4B Spot2 V3

                        macmacmacmac · Hugging Face package release: 4 Nov 2026 · CUSTOM LICENCE

                        A Qwen3.5-4B-Base LoRA and Kev head for authorising outgoing tool calls. Bootstrap code fetches the pinned backbone and Kev source. The card leads with the full held-out test and warns that a threshold calibrated on development data transfers badly across domains.

                        Package
                        LoRA adapter, pointer head, inference code and evaluation records
                        Licence
                        SecJev Use and Distribution Agreement v1.0; custom terms
                        • The maker reports AUROC 0.8661 on 7,192 full-test rows. At the development threshold 0.0021, test true-positive rate is 0.776 and false-positive rate 0.221, versus development false-positive rate 0.010. No independent replication under its frozen chain is reported. vendor reportedsource

                        CodeSync Knack

                        DevsHub · Hugging Face package release: 4 Nov 2026 · LOCAL BUNDLE

                        A local CodeSync bundle with 29 fixed judgments about user turns and shell commands. The same v3 release now includes Q8_0 and Q4_K_M GGUF files plus a standalone Python runner for Ollama. Unsupported questions inside CodeSync go to its cloud judgment service. No model licence is supplied.

                        Questions
                        21 turn judgments and 8 shell-command judgments
                        Access
                        CodeSync bundle; standalone Ollama runner and GGUF files
                        Licence
                        Not specified in the card or file inventory
                        Runtime
                        Ollama makes one request per question; the built-in runtime answers a turn in one forward pass
                        • DevsHub reports 97.9% on 233 hand-labelled decisions, 95.5% on 3,267 held-out session decisions and 93.7% on 4,120 rare cases. Its 13 ms median is measured on an unspecified laptop GPU. The card does not establish general question-answering performance. vendor reportedsource
                        • The maker reports Ollama Q8_0 accuracy 97.9%, 95.7% and 93.6% on the 233, 3,267 and 4,120-decision sets, with about 80 ms median per eight-question command on a laptop GPU. These are serving-format checks of v3, not a newly established trained checkpoint. The runner only classifies the supplied command; it never executes it. vendor reportedsource

                        Jev-style spam LoRA

                        Abubakar Abid · Hugging Face package release: 5 Nov 2026 · OPEN

                        A Qwen3.5-2B LoRA for one forum-spam question. It reads yes/no token logits as a spam probability after supervised training on the dataset’s training split. It is independent of TypeSafe’s hosted Jev and needs the separate Qwen base.

                        Task
                        Binary forum-spam detection; text truncated to 1,500 characters in evaluation
                        Package
                        PEFT LoRA adapter; separate Qwen3.5-2B base
                        Licence
                        Apache-2.0
                        • The maker reports 2,723 of 2,725 test rows correct, F1 0.9993 and ECE 0.001, with two false positives and no false negatives. Spam examples are largely synthetic promotions. The fine-tune saw this dataset’s training domain while the compared open models were general-purpose; no result against TypeSafe’s Jev is claimed. vendor reportedsource

                        Heimdall D1 V6

                        Toby-NoSkillSon · Hugging Face package release: 4 Nov 2026 · OPEN

                        A text-only d1-2B fine-tune that decides whether transcribed speech is for a voice assistant, still unfinished or meant for someone else. It runs through MLX on Apple Silicon. The fixed question was trained around the names Toby and Heimdall; the state can supply other names. The weights preceded this scan window; the in-window card explains their lineage.

                        Inputs
                        Conversation transcripts; speech recognition runs first
                        Formats
                        BF16, int8 and int4 packages
                        Licence
                        LFM Open License v1.0; commercial revenue limit applies
                        • The maker reports two training stages totalling about 175 million tokens across ten languages. The card gives no held-out dispatch accuracy, so training scale does not establish reliable wake-word-free behaviour. vendor reportedsource

                        Zuse

                        Bineric · HOSTED

                        A European hosted decision-model family with 9B and 27B API choices. It accepts text plus yes/no, choice and scale questions through /v1/zuse, returning probabilities without generated answers. The paper studies 4B, 9B and 27B adapters; the public API page lists 9B and 27B. Its release date is unconfirmed.

                        Hosted models
                        zuse-9b and zuse-27b
                        Inputs
                        Text; yes/no, choice and scales; up to 255 choice options
                        Context
                        65,536 tokens per document on the API
                        Price
                        $0.12 per million input tokens for 9B; $0.75 for 27B; no output tokens · Compare prices
                        Access
                        Bineric API; dedicated and on-premises deployments by arrangement
                        • The author reports 87.5% accuracy for 27B on a 27-language development suite that also guided model selection, with one seed. Pooled ECE is 0.016 and source-weighted ECE 0.035. These are development results, not untouched test accuracy. vendor reportedsource

                        RSI-Jev v7.0-VL family

                        Shanghua Gao · First Hugging Face package release: 5 Nov 2026 · OPEN

                        Qwen3.5-derived decision models with text exits at different depths. The 4B package has 32 decoder layers; the 3.30B sibling keeps its first 20 layers and existing heads without retraining. Both read text and up to four images, returning option probabilities without generated text. Images use the full depth of the chosen package. Their runtime supplies option echo and prefix-bidirectional attention.

                        Size
                        4B package: 4.69B parameters and about 9.7 GB; 3B package: 3.30B and 6.8 GB
                        Inputs
                        Text and up to four images; choice, noul and score
                        Licence
                        Apache-2.0
                        Limits
                        32,768 tokens; up to 5,120 options; overlength requests get HTTP 422
                        Access
                        Public weights with the RSI-Jev runtime; no causal prefix cache
                        Newer package
                        3B (cut at layer 20) uploaded 7 Nov 2026
                        • The maker reports 60.61 on the public Decision Index 0.3, with 29.4 ms median and 236 ms p95 on one RTX PRO 6000 Blackwell at default effort. This is a public-suite run, not the full private index. Training used one seed and unreleased data. Ambiguous KoBBQ questions and some medicine and customer-support tasks regress against v6.1-VL. vendor reportedsource
                        • For the released 3B package, the maker reports public Decision Index 0.3 score 60.01, 19.6 ms median and 151 ms p95 on one RTX PRO 6000 Blackwell. All 4,001 checked rows match the 4B at medium effort bitwise. Against the full-depth 4B, held-out accuracy falls from 0.811 to 0.797 and MMLU-Pro from 0.502 to 0.469. The package reuses the 4B temperatures and thresholds. vendor reportedsource

                        Vica Laya

                        tory-labs · 2026.11.08.1 trained release: 8 Nov 2026 · OPEN

                        A Korean-focused Laya multilingual fine-tune. Release 2026.11.08.1 continues from the previous original float checkpoint on private knowledge-graph and research summaries. It ships armD-final-epoch-3 as Q8_0 and original float weights. The maker records a release override with prior-task retention and news checks still unrun; it is not a selection-protocol pass.

                        Inputs
                        Text; Korean and English
                        Licence
                        Apache-2.0
                        Access
                        Self-contained macOS arm64, Linux x86_64 and Windows x86_64 runtime bundles; original float checkpoint for laya 0.4.22. The Laya GGUF is not an Ollama or llama.cpp chat-model package
                        • The maker reports 155/178 calibration and 153/185 test summaries correct, versus 135/178 and 132/185 for the previous release. Labels come from two Opus 5.5 passes without human adjudication. Calibration selects the epoch and temperature; the test split compared all four experiment arms, so no independent final test is claimed. Existing news cohorts, judgment-retention tasks and warm-daemon latency were not measured for this release. vendor reportedsource

                        Spot Snake decision fine-tunes

                        Lucasgitguy-co · d1/MiniMind-JEV licence clarification; Laya weights uploaded 6 Nov: 5 Nov 2026 · MIXED LICENCES

                        Four local move-ranking fine-tunes for Spot’s Biscuit Snake: d1-2B, d1-3B, MiniMind-JEV and Laya Multilingual. The game supplies safe moves; the model ranks them to imitate a heuristic teacher that leaves the most open room. Keep the game’s collision checks. The d1-2B, d1-3B and MiniMind-JEV weights were uploaded on 5 November; the Laya Multilingual weights were uploaded on 6 November.

                        Variants
                        d1-2B and d1-3B merged weights with GGUF formats; MiniMind-JEV ranking head and BGE encoder; Laya Multilingual fine-tune
                        Inputs
                        Game state and candidate safe moves
                        Licence
                        d1 variants: LFM Open License v1.0 plus Apache-2.0 contributions (LvW-license-Snake-1.0); MiniMind-JEV: MIT; Laya Multilingual: Apache-2.0
                        Calibration
                        Laya Multilingual: temperature fitted on 400 reserved training-split rows, returning approximately 1.0. d1-2B, d1-3B and MiniMind-JEV: confidence was not recalibrated after training
                        Multilingual release
                        Laya Multilingual fine-tune; English and Dutch; laya 0.4.26
                        • On 1,708 held-out moves, the maker reports 99.82% teacher agreement for d1-3B and 55.80% for MiniMind-JEV. Saved-file reload checks cover 32 rows. Teacher agreement measures imitation of the heuristic; game scores, win rates and speed were not measured. vendor reportedsource
                        • The multilingual card reports 99.94% teacher agreement on 1,600 challenge cases, with English and Dutch using the same boards. It reports ten-bin ECE 0.0483. These are teacher-label checks; game score and win rate need separate rollouts. vendor reportedsource

                        JAD-S1-7B-A1B v0.3

                        DreamBlooms · Hugging Face package release: 5 Nov 2026 · OPEN

                        A LoRA decision adapter on LLaDA-MoE-7B-A1B-Instruct. One masked forward pass returns a probability distribution over option letters, with no generated answer. The base weights must be downloaded separately. Use its bundled inference script for the recorded scores; it repairs a rotary-embedding compatibility issue.

                        Base
                        LLaDA-MoE-7B-A1B-Instruct; separate base download
                        Licence
                        Apache-2.0 adapter, code and base
                        Limits
                        2–26 letter-labelled options, six recommended; 4,096 tokens recommended, up to 8,192 supported
                        Access
                        Public LoRA adapter and inference.py
                        • The maker reports 195 of 231 public JevBench v1.2.2 tasks correct (84.4%), versus 155 for the base using the same script. Published competitor rows use different serving protocols. On 66 evidence-silent VitaminC cases, it selects “not enough info” for only 16. Calibration fitted on English decision data needs checking on other tasks. vendor reportedsource

                        swiftpick-30B-A3B

                        harishvs · Hugging Face package release: 5 Nov 2026 · CUSTOM LICENCE

                        A decision adapter and readout head trained on the text decoder of Nemotron-3-Nano-Omni-30B-A3B. The adapter combines three training runs. The same weights can read images, video and audio through the base’s frozen encoders using the tagged multimodal runtime. Media were not used in training. The repository’s main branch and released package versions cannot load this base.

                        Base
                        Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16 text decoder
                        Inputs
                        Text; zero-shot images, audio and video with at most 16 frames; choice, noul and score
                        Licence
                        NVIDIA Open Model Agreement for the model derivative; code Apache-2.0
                        Hardware
                        62.5 GB bf16 base download; one 80 GB GPU or multiple GPUs, plus CUDA Mamba kernels
                        Access
                        Public adapter and head; swiftpick-30B-A3B-v1-mm runtime tag
                        • The maker reports 183 of 231 public JevBench items correct (79.22%), Brier 0.287 and ECE 0.059 at a 4,096-token window. Its separate 42.4 Intelligence estimate uses only the open half of the v1.5 method and omits sealed items and other axes; it is not an official score or rank. Questions are sometimes under-read, and calibration transfers poorly beyond the fitted short tasks. vendor reportedsource
                        • In one H100 bf16 serving evaluation, the maker reports NaturalBench accuracy 0.820 on 1,200 items, MINDS-14 en-US 0.986 on 563 and Perception Test video 0.720 on 300. Removing media reduces performance, but mean confidence remains 0.74 to 0.82 on image and keyword sets. Media presence needs checking; these few public sets do not establish broad multimodal reliability. vendor reportedsource

                        Saif 4B v2

                        GyrTechnology · v2 decision-only package release: 5 Nov 2026 · NON-COMMERCIAL

                        A Qwen3.5-4B full decision fine-tune that returns probabilities for typed questions in one forward pass. The v2 release replaces the earlier full-model files with a decision-only package; v1 remains tagged. Its licence restricts use to non-commercial purposes because some training sources are research-only.

                        Base
                        Qwen/Qwen3.5-4B
                        Inputs
                        Text state; choice, noul and score
                        Licence
                        CC BY-NC 4.0; non-commercial
                        Access
                        Public decision weights, runtime and Decision Index engine
                        • GyrTechnology reports 57.71 chance-corrected skill and 68.61 raw on the complete public Decision Index 0.3 suite, with no unsupported requests. This is the maker’s run, not an independently reproduced full-index rank. vendor reportedsource

                        karpo-decision-31B

                        MachinePulseAI · Hugging Face package release: 5 Nov 2026 · OPEN

                        A text-only Gemma-4-31B-it fine-tune with a linear readout over supplied options. One pass answers choice, noul and score questions. The checkpoint contains vision weights, but the runtime does not use them. Its probabilities have not been calibrated.

                        Size
                        31.3B bf16 parameters plus a 255 by 5,376 fp32 readout
                        Inputs
                        Text or JSON; up to 255 options
                        Context
                        32,768 tokens per sequence; multi-question requests can be split, with the full state in each part
                        Hardware
                        62.5 GB of weights; longer requests need additional memory
                        Licence
                        MachinePulse Community License effective 12 Nov 2026. Earlier Apache-2.0 copies retain their rights; inference code is separately Apache-2.0
                        Commercial terms
                        The weight licence effective 12 Nov 2026 requires attribution for external commercial use and a separate agreement for commercial production above US$10M annual revenue, including affiliates
                        • The maker reports public Decision Index 0.3 score 75.05 across 140,178 scored requests, and private Full score 73.86 on the 11 Nov 2026 Decision Index 0.4.1 board. The private result is a maker report, not a reproduced test. vendor reportedsource

                        JevStyle 2B

                        Chaoliang Yan · Hugging Face package release: 5 Nov 2026 · OPEN

                        An independently maintained 2.21B typed-decision model with a frozen vision tower. Its diagnostic continuation raises the reported public score but fails its pre-registered calibration guard. The required renderer, attention mask and verdict readout ship with the weights; generic chat runtimes do not reproduce its probabilities.

                        Size
                        2,213,241,664 parameters including the vision tower
                        Inputs
                        Text and images; image smoke checks, without a new full vision benchmark
                        Context
                        32,768 tokens; up to 255 options; overlength inputs refused
                        Licence
                        Apache-2.0; upstream data and teacher-output terms still apply
                        Access
                        Merged weights and custom runtime; separate text-only GGUF and MLX packages
                        • The maker reports 46.74 on the complete public Decision Index 0.3 suite, versus 44.37 for its parent, with 140,178 successful requests. ECE rises from 0.0195163271 to 0.0300812254, exceeding the allowed 0.01 increase. Concurrent CUDA timings are not serial request latency. vendor reportedsource

                        Laya spam classifiers

                        Nikita Kolmogorov · Hugging Face package release: 6 Nov 2026 · OPEN

                        Two multilingual Laya fine-tunes copy Jev judgments for Telegram messages and Farcaster casts or accounts. The Telegram bot uses a 0.81 deletion gate and exempts admins. Farcaster ships Platt scaling for its raw scores. The evaluations measure agreement with the teacher, including its mistakes.

                        Base
                        convaiinnovations/laya-multilingual
                        Inputs
                        Text, links and metadata; no media-content or avatar inspection
                        Training
                        Telegram: 5,540 messages, with training data unreleased; Farcaster: 16.6k casts and 4,384 account snapshots
                        Licence
                        Apache-2.0, according to both model cards
                        Access
                        Public weights, question files and loading examples for both classifiers
                        • The maker reports 95.4% agreement with Jev on 978 held-out Telegram messages at the 0.81 gate, precision 0.82 and recall 0.70. These compare with Jev's delete labels, not human judgments. Reported median latency is 38 ms on an Apple GPU and about 400 ms on a few CPU threads. vendor reportedsource
                        • The maker reports 95.7% agreement on 2,489 held-out Farcaster casts at gate 0.5, precision 0.92 and recall 0.80. Account agreement is 97.1% on 652 held-out accounts. The newest 15% is held out by time; new spam styles may differ. vendor reportedsource

                        OneJev 31B

                        OmniJev · OneJev1.6g weight release: 8 Nov 2026 · OPEN

                        A Gemma-4-31B-it decision family served through Flide. The 1.5g package describes screenshots, photographs and text; the newer 1.6g card documents text and choice, noul and score questions. No new image capability is inferred from the earlier package, and neither card supplies a measured accuracy or calibration result.

                        Base
                        google/gemma-4-31B-it
                        Inputs
                        1.6g: text. The earlier 1.5g card describes text and images
                        Licence
                        Apache-2.0, according to the card
                        Access
                        Merged safetensors and a Flide serving example

                          Copernicus 31B / 57B

                          Poindexter Labs · First Hugging Face package release: 4 Nov 2026 · OPEN

                          Poindexter Labs publishes 31B and 57B structured-decision packages with System One servers. The 57B combines Gemma-based and Qwen-based components and accepts text or JSON. The 31B Transformers path reads text; its image path requires compatible SGLang serving. Probabilities need validation on the deployment task.

                          Size
                          Approximately 31B, or 57B across two components
                          Inputs
                          57B: text and JSON only; 31B image support depends on a compatible SGLang backend
                          Questions
                          Up to 64 per request in the reference server
                          Licence
                          Apache-2.0, according to the card
                          Access
                          Public 31B and 57B weights with separate reference serving code
                          57B limits
                          64 questions per request; 2 to 255 choices; 40,000-token input proxy and 32,768 tokens per rendered input; overlength requests refused
                          Newer package
                          57B weights uploaded 6 Nov 2026
                          • Poindexter Labs reports 75.34 on the full public Decision Index 0.3 suite of 140,178 requests for 57B. Its latency sample covers only 300 public-suite requests, with 270 ms median on one RTX PRO 6000. These are maker measurements, separate from the index maintainers' private evaluation. The reference setup uses a 96 GB NVIDIA GPU and about 110 GB of model files. vendor reportedsource

                          Scantron Preview

                          aidendle94 · Hugging Face package release: 4 Nov 2026 · RESEARCH PREVIEW

                          A research d1-2B fine-tune for proposed agent actions, followed by a 10,240-weight output-head edit. Fixed questions cover risk, review, injection and authorization. The card corrects an earlier evaluation whose question selection revealed labels. Long states are truncated at 8K tokens, and authorization remains weak.

                          Size
                          1.92B parameters with an untied output head
                          Inputs
                          JSON action, user request and surrounding context; fixed trace or command question sets
                          Context
                          128K architecture context; states trained and evaluated only up to 8K tokens
                          Licence
                          LFM Open License v1.0
                          Access
                          Weights, custom Transformers code, calibration, questions and edit provenance
                          • The maker reports 0.971 AUROC on 2,808 LlamaFirewall traces and 0.736 AUROC for review on 822 ATBench traces. Authorization balanced accuracy is 57.6% on 621 AuthorizationBench items and 32.5% on 175 Mailu actions across three classes. All traces receive the same three questions; 451 LlamaFirewall traces are truncated. These results do not establish a production safety control. vendor reportedsource

                          Sarvam Prism

                          Sarvam AI · Hugging Face package release: 3 Nov 2026 · OPEN

                          A Sarvam-105B decision fine-tune, offered as custom FP8 weights and a hosted API. It returns option probabilities without generating text. Choice options are sorted by key before scoring. The hosted API and downloadable runtime have different context limits.

                          Size
                          105B; about 106 GB of weight files
                          Inputs
                          Text or JSON; no images
                          Context
                          Hosted: 32,768 tokens per question; local runtime: 131,072
                          Hardware
                          Local FP8 runtime needs about 120 GB free GPU memory; tested on B200
                          Licence
                          Apache-2.0
                          Price
                          Sarvam API: ₹4 per million input tokens; output free · Compare prices
                          Access
                          Public weights and prism.py; hosted POST /v2/systemone
                          • Sarvam reports 44 ms median and 420 ms p95 on 1,000 serial public-index requests on a B200. vendor reportedsource
                          • In its 2,000-question shuffle test, fixed-order preprocessing yields zero changed answers; scoring options as sent changes 4.0%. Sorting is part of the tested system. vendor reportedsource

                          Kanana-2-v-decide

                          Kakao · Weights upload: 6 Nov 2026 · OPEN

                          A text/image decision model built on Kanana-2-v-3b. It compares state/question embeddings with candidate embeddings and returns option probabilities. Candidate embeddings can be cached. The supplied HTTP server processes one request at a time.

                          Size
                          3.67B: 3.18B language model and 0.49B vision encoder
                          Inputs
                          Korean or English text, JSON or chat; up to 10 images; no video
                          Context
                          20,480 tokens; overlong inputs are shortened by default, or rejected with --strict-inputs
                          Licence
                          Kanana Open License
                          Access
                          Public weights, custom Transformers code and /v1/systemone server
                          • Kakao reports 61.34 on public Decision Index text and 61.12 on vision, averaging 61.23 across those two scores. Its Korean benchmark score is 72.50 over 15,909 questions. These are maker results, not a combined ranking of all decision models. vendor reportedsource

                          Agastya Decision RAG 2B

                          Andra Labs (Amartya Sai Andra) · Weights upload: 6 Nov 2026 · OPEN

                          A Qwen3.5-2B fine-tune with an Unsloth Clef decision head, intended to choose sections in table-of-contents retrieval. It was trained on general typed decisions. Retrieval, citations and final answer writing remain the application’s job; table-of-contents routing quality is unmeasured.

                          Base and size
                          Qwen3.5-2B; merged backbone plus separate decision-head weights
                          Inputs
                          Typed state and choice, noul or score questions
                          Context
                          Decision config records max_len 4,096; backbone settings are not a tested task limit
                          Licence
                          Apache-2.0
                          Access
                          Public weights; Unsloth FastDecisionModel required for typed inference; hosted handler deployment untested
                          • The training record reports 66.0% accuracy and 0.0948 ECE over 150 held-out decisions, against 37.33% and 0.0967 for the base. The split, seed and evaluation script are absent. These are general decision results, not a retrieval benchmark. vendor reportedsource

                          termite-decide 0.8B

                          Tane Piper · Weights upload: 7 Nov 2026 · OPEN

                          A Kev-0.8B fine-tune that judges shell commands for termite. It asks whether a command only reads, keeps secrets hidden or could do harm, and can rank candidates. The 0.2 weights are rebuilt from documented training sources. In termite its judgment can only tighten the rules; harmful commands can still pass the model.

                          Size
                          0.8B; 812 MB Q8_0 GGUF
                          Inputs
                          English shell commands
                          Runtime
                          llama.cpp with /v1/systemone; only that server was tested
                          Licence
                          Apache-2.0; 0.2 uses CC BY 4.0 tldr-pages text and project-written rows
                          Access
                          Public GGUF weights
                          • On the maker’s fixed 141-command allowed test, 0.2 rates 5 of 48 harmful commands safe and 46 of 68 harmless reads safe. Its risk-order tau is 0.678, down from 0.698, and the safest candidate ranks first in 3 of 10 ladder choices. The ladder informed run selection and three acceptance marks were set after initial scores were seen. vendor reportedsource
                          • The model does not check whether a command exists. The card says rules catch missing programs and cut-off lines, but not made-up options. Linux was not tested separately for 0.2, and the unpublished rule-labelled training rows do not establish independent safety correctness. vendor reportedsource

                          Qwen3.5-4B-Router-1M

                          Maziyar Panahi · Weights upload: 6 Nov 2026 · OPEN

                          A Qwen3.5-4B LoRA and Unsloth decision head for next-action and tool routing. Training used 17,600 source-labelled rows; the name refers to the larger merged data pool. Jev answers were excluded from training. It is unsuitable as a general trace judge.

                          Base and size
                          Qwen3.5-4B; adapter and separate decision head
                          Inputs
                          Software-agent and customer-service traces
                          Context
                          4,096 tokens; reported test states up to 13,000 characters
                          Licence
                          Apache-2.0
                          Access
                          Public adapter; Unsloth FastDecisionModel and base weights required
                          • The maker reports 86.5% agreement with source labels on 480 held-out rows, against stored Jev 1.13 answers at 80.6%. These labels describe the source trace’s next action or parsed tool call, not human correctness. Trace-disposition results are weak. vendor reportedsource

                          Decisio 12B tuned v2 commit

                          tachara-ai · Weights upload: 6 Nov 2026 · OPEN

                          A Gemma 4 12B fine-tune with merged weights for the decisio runtime. Its commit rule pushes yes/no probabilities inside the 0.20 to 0.80 band to that band’s edge on the same side. This preserves the winning answer while changing calibration.

                          Base and size
                          Gemma 4 12B; merged bf16 weights
                          Inputs
                          State and typed choice, yes/no or score questions
                          Runtime
                          decisio 0.35.0 or later; plain vLLM does not apply the full readout
                          Licence
                          Apache-2.0, per card and included licence
                          Access
                          Public weight shards and decision_config.json
                          • The maker says temperatures were fitted by log loss and training was checked against both boards’ public test sets. Training data are undisclosed; the card supplies no task-accuracy result. vendor reportedsource

                          Rein r1 family

                          jmc0 · Weights upload: 6 Nov 2026 · OPEN

                          Open 0.8B and 4B decision models that steer a separate chat model using rules supplied per request. Turn and partial-draft judgments can request tools, enforce an opening phrase or stop a reply. Rein returns decisions; the chat model writes the text.

                          Variants
                          Rein-r1-0.8B and Rein-r1-4B
                          Inputs
                          Rule sheets and text conversations; English and Portuguese best measured
                          Runtime
                          Custom Transformers decision and session-control code
                          Licence
                          Apache-2.0, per both cards
                          Access
                          Public merged backbone and decision-head weights
                          • The maker reports 96.8% decision accuracy and 0.003 ECE for 4B on 28,430 questions about held-out rules. Labels are synthetic and audited by another model. End-to-end chat tests still contain rule violations; they are small sampled sessions judged by Qwen. vendor reportedsource

                          Vev 4B v2

                          Wang Xiaolong · Weights upload: 6 Nov 2026 · NON-COMMERCIAL

                          A Qwen3.5-4B text/image decision fine-tune with merged weights and a Jev-like API. Its runtime uses bidirectional attention within the state and repeats some inputs. Plain causal inference produces different probabilities. This research preview is noncommercial.

                          Size
                          4B; merged weights
                          Inputs
                          English or Chinese text, JSON and images
                          Runtime
                          vev serve on an NVIDIA GPU; checkpoint-specific attention and repetition settings
                          Licence
                          CC BY-NC 4.0; Apache-2.0 base licence retained
                          Access
                          Public merged weights; no separate adapter
                          • The maker reports public vision skill 72.90 and text skill 60.32, with disclosed training/evaluation overlaps and a text-suite hash mismatch outside the index. Across 18 release sets, ECE ranges from 0.01 to 0.24; four sets regress versus Vev 4B. No full private-board score is supplied. vendor reportedsource

                          Compliance Decisions 0.8B

                          souvickdascmsa019 · Weights upload: 6 Nov 2026 · OPEN

                          A Qwen3.5-0.8B LoRA plus an Unsloth Clef head for fixed sheets of regulatory and general questions. The calibration split was left unused, so this release is uncalibrated. It is intended for triage and routing, with mixed expert and teacher label provenance.

                          Size
                          0.8B base with LoRA and separate joint decision head
                          Inputs
                          Text/JSON cases and fixed typed-question sheets
                          Context
                          4,096-token training setting; serving reads up to 16,384 without a matched long-context test
                          Licence
                          Apache-2.0 model tag; derived dataset CC BY 4.0
                          Access
                          Public adapter and head; Unsloth required, standard PEFT alone omits the head
                          • The maker reports 0.8906 accuracy on in-distribution legal questions and 0.7778 on the separate AIReg transfer set, with ECE 0.0237 and 0.0869. Shared source vocabulary helps the first score. The mixed labels and unused calibration split limit interpretation. vendor reportedsource

                          JDI-Decision-V1

                          JD Industrials · Weights upload: 1 Nov 2026 · OPEN

                          A Qwen3.8-27B decision system that combines vision features with frozen PaddleOCR v5 transcriptions. OCR and image encoding run concurrently on one GPU. Published vision scores and timings cover the whole system; the internal decision backbone alone omits OCR.

                          Base and size
                          Qwen3.8-27B with D3 decision adaptations
                          Inputs
                          Text and images, including internal OCR transcriptions
                          Runtime
                          Python 3.12 and CUDA; complete-system ComboEngine or custom AutoModel loader
                          Licence
                          Apache-2.0 model tag; OCR components retain upstream terms
                          Access
                          Public weight shards, complete-system inference code and reproduction guide
                          • The maker reports public Decision Index Vision skill 79.7313 on 12,210 successful requests, with 263.4 ms median on H200 replicas. Loading is excluded. Private evaluation and official RTX PRO 6000 timing validation remain pending; this is not a confirmed full-board rank. vendor reportedsource

                          Jeva 4B

                          Qi Li and Xinchao Wang (NUS) · Weights upload: 9 Oct 2026 · OPEN

                          A text decision model with Qwen3.5-4B backbone, adapter and a separate decision head. It supports choices, yes/no and rubric scores, with an explicit none-of-the-above option. The authors design its candidate readout for option reuse and reordered candidate sets.

                          Base and size
                          Qwen3.5-4B
                          Inputs
                          Text with supplied candidate options or scoring rubric
                          Licence
                          Apache-2.0 weights and decision head; base licence retained
                          Access
                          Public backbone, adapter and head.pt; use the Jeva project’s loading guidance
                          • The authors describe null-aware, permutation-invariant and cacheable candidate scoring. The checked model card has no numerical benchmark; these are design claims, not a fresh reproduction. vendor reportedsource

                          RASD Laya track classifier

                          Galal Ban Amr · Selected weights upload: 7 Nov 2026 · OPEN

                          A Laya fine-tune that labels English descriptions of simulated sensor tracks as drone, bird, aircraft or unknown. It classifies only, with no flight-control or engagement outputs. Training and testing use the same simulator with separate runs; the results say nothing about real sensors or airspace.

                          Base
                          convaiinnovations/laya, ModernBERT-large
                          Inputs
                          English text in the synthetic dataset's fixed track format
                          Training
                          10,814 rows, two epochs, soft cross-entropy; run-D selected on validation macro-F1
                          Licence
                          Apache-2.0 model card
                          Access
                          Public weights, question file and Laya loading example
                          • The maker reports accuracy 0.956, macro-F1 0.903 and 15-bin ECE 0.005 on 23,358 synthetic test rows from held-out simulation runs. The rule baseline scores 0.386 accuracy and abstains as unknown when evidence is thin, which the test counts as wrong for a real object. Fine-tuned unknown-class precision is 0.571. These results measure generalisation within one simulator. vendor reportedsource

                          MoDe S / M / L

                          newrexlabs · Weights upload: 7 Nov 2026 · NONCOMMERCIAL

                          Three sparse MobileMoE decision fine-tunes for English text or JSON. They score supplied options in one forward pass, with a pointer head and temperature scaling by question type. Weights use a noncommercial research licence; inference code is Apache-2.0. Training code and data are not released.

                          Size
                          S: 1.27B total / 0.28B active; M: 2.82B / 0.53B; L: 5.33B / 0.93B
                          Inputs
                          English text or JSON; choice, noul and score
                          Context
                          8,192 tokens per pass; split longer requests by question, reject a single question that does not fit
                          Licence
                          Weights: FAIR Noncommercial Research License and Acceptable Use Policy; inference code: Apache-2.0
                          Access
                          Public weights and MoDe inference package; custom model code requires trust_remote_code=True
                          • The maker reports public Decision Index 0.3 scores of 42.02, 47.10 and 51.36 for S, M and L on 140,178 requests. Four overlength requests count as wrong. These submissions have not been verified by the benchmark maintainers. vendor reportedsource
                          • The maker reports medians of 11.0, 17.7 and 25.0 ms for S, M and L on a half-card RTX PRO 6000 MIG partition. Each is the median of five run medians over 700 requests after ten warm-ups, using bf16 and each model’s own engine. These are not full-card leaderboard timings. vendor reportedsource

                          Laya Minecraft

                          Thomas Tesche · Weights upload: 7 Nov 2026 · OPEN

                          An English Laya fine-tune for a Minecraft agent. Code removes impossible actions; the model chooses an intent and answers a danger question, then an executor acts and a verifier checks progress. The encoder is frozen during this training run. Its reported evaluation contains training or calibration overlap.

                          Base
                          convaiinnovations/laya, ModernBERT-large
                          Inputs
                          English game-state descriptions and valid action candidates; intent and in_danger choice questions
                          Training
                          2,564 verified decision ticks, four epochs; temperatures fitted on 284 calibration items
                          Licence
                          Apache-2.0 model card
                          Access
                          Public weights, question signatures and train_report.json; Laya runtime
                          • The maker reports accuracy 0.9301 before fine-tuning and 0.9325 after, with ECE moving from 0.0625 to 0.0435 on 415 items. Four items overlap training or calibration, so this is not a strictly held-out result. No score or noul items were trained. vendor reportedsource

                          medgemma-decide-4b-v2

                          Amaljith · Weights upload: 7 Nov 2026 · RESEARCH ONLY

                          An English medical-text decision fine-tune continued from a MedGemma 1.5 4B derivative. It scores typed options without generated text. Minority-class oversampling changes the decision balance, with gains and regressions across questions. Research use only, not for diagnosis, triage, clinical decisions or patient care.

                          Base
                          unsloth/medgemma-1.5-4b-it, continued from the maker’s first released checkpoint
                          Inputs
                          English medical text and supplied typed options; text only
                          Training
                          Fresh rank-16 LoRA; one epoch, 728 steps, 51.7 minutes on an A100 80 GB, according to the card
                          Licence
                          Health AI Developer Foundations terms; derivative notice included
                          Access
                          Public merged weights, joint decision head, adapter, inference code and per-question temperatures
                          • The maker reports medline/adverse balanced accuracy rising from 0.625 to 0.825, above its TF-IDF baseline floor of 0.721. Macro balanced accuracy across sources falls from 0.689 to 0.686. The evaluation has 15,320 records and 19,480 decisions; balanced accuracy uses a prior-adjusted decision rule. vendor reportedsource
                          • The card reports PubMedQA balanced accuracy falling from 0.578 to 0.488 under that rule. Public exam sets, MeSH labels and one seed per run limit interpretation; seed variance is unmeasured. This is not clinical validation. vendor reportedsource

                          medical-jev-4b

                          JuneYao · Weights upload: 2 Nov 2026 · OPEN

                          A Qwen3.5-4B LoRA for supplied medical answer choices, mainly in Chinese. It reads next-token option logits in one forward pass and returns probabilities without an explanation. This is independent of TypeSafe’s hosted Jev. The released adapter is for teaching and offline research, not clinical use or triage.

                          Inputs
                          Case text, instructions and supplied choices; mainly Chinese, with other languages represented
                          Limits
                          Released runtime: 52 options and 8,192 tokens; larger menus require the repository’s experimental tournament mode
                          Licence
                          MIT code and adapter; Apache-2.0 base, with separate upstream data terms
                          Access
                          Public custom-format LoRA and inference bundle; not PEFT-compatible
                          Provenance
                          Catch-up weights released 2 Nov; source repository published 7 Nov
                          • The maker reports 1,028 of 1,514 benchmark questions correct (67.90%) with the released 52-option runtime; 100 unsupported questions count as wrong. Experimental tournament handling raises this to 1,050 (69.35%). The benchmark was repeatedly used for development and is not a blind test. vendor reportedsource
                          • The maker reports 40 of 100 triage questions correct and uncalibrated benchmark ECE around 0.13. The original training file is lost; the public pool was reconstructed and may include sources from a later 1,557-item evaluation. That evaluation is not an untouched test of the released adapter. vendor reportedsource

                          LingeeJevMulti-4B-v1

                          Ashan0525 · Weights upload: 8 Nov 2026 · OPEN

                          A Qwen3.5-4B derivative that reads text or images and returns probabilities for Choice, Noul and Score questions without generating an explanation. The release includes full model weights, a separate decision readout and a System One server.

                          Size
                          4.54B, including a 0.33B vision encoder
                          Inputs
                          Text or structured state and images
                          Image limit
                          1,638,400 pixels per image
                          Licence
                          Apache-2.0
                          Access
                          Public weights, Python runtime and POST /v1/systemone

                            Logits Sigma-1 / Duo

                            Logits · Weights upload: 7 Nov 2026 · OPEN

                            Two text decision packages. Sigma-1 merges a LoRA into Gemma 4 31B and reads option-code logits. Duo averages option probabilities from a modified KnowLine 31B and d3-ultra, both in FP8. Above 50,000 request characters, Duo uses its first member alone.

                            Inputs
                            Text state and typed choice or yes/no questions
                            Licence
                            Apache-2.0 code and weights; training sources include share-alike, copyleft-labelled and possibly non-commercial data
                            Access
                            Public weights and Decision Index engines; one 96 GB GPU in the reported setups
                            Limits
                            Sigma-1 refuses prompts above 131,072 tokens or menus above 255 options
                            • Logits reports a public Decision Index 0.3 score of 67.1 for Sigma-1 over 140,178 scoreable requests. Model selection used a subset of the public suite, making these scores partly in-sample. No private Full score is supplied. vendor reportedsource
                            • Logits reports a public Decision Index 0.3 score of 72.93 for Duo over 140,178 scoreable requests. Model selection used a subset of the public suite, making these scores partly in-sample. No private Full score is supplied. vendor reportedsource
                            • On one RTX PRO 6000, the maker reports median/mean request times of 122/356 ms for Sigma-1. vendor reportedsource
                            • On one RTX PRO 6000, the maker reports median/mean request times of 293/859 ms for Duo, with GPU memory peaking at 87,891 MiB. Its published training disclosure includes source-licence restrictions that the package licence does not settle. vendor reportedsource

                            d1-2B RAG Verifier

                            landtml · Weights upload: 8 Nov 2026 · OPEN

                            A d1-2B LoRA for checking whether a supplied answer is supported by its source. It returns one response-level support probability, without identifying unsupported spans. Use the recorded source/request/answer fields and the exact question from the card.

                            Size
                            1.9B
                            Inputs
                            English source, request and generated answer
                            Licence
                            LFM Open License v1.0
                            Access
                            Merged BF16 weights, LoRA adapter, Q8_0 GGUF and scoring records
                            Evaluation scope
                            RAGTruth; training sources capped at 12,000 characters, with longer inputs unevaluated
                            • The maker reports F1 81.5, AUROC 0.936 and ECE 0.030 on 2,700 RAGTruth responses. Checkpoint and threshold 0.56 were selected on document-grouped development data. The base comparison reports F1 70.9 but uses Q8_0 llama.cpp while the fine-tune uses BF16. Base-training overlap is unknown; third-party table rows use their own papers and code. vendor reportedsource

                            LocHeal Verdict 2B

                            kinasr · Weights upload: 7 Nov 2026 · OPEN

                            A d1-2B fine-tune for choosing a replacement DOM element when a browser-test locator breaks. It reads an annotated screenshot, broken-locator details and live candidates, with an Unknown option for a missing target. The card gives no held-out accuracy or false-heal rate.

                            Size
                            1.92B
                            Inputs
                            Set-of-Marks screenshot, locator details and DOM candidates
                            Licence
                            LFM Open License v1.0
                            Access
                            Merged BF16 weights, LoRA backup and custom Transformers code
                            • The card proposes stopping a test for Unknown or confidence below 0.75. This is a suggested operating rule, with no published error guarantee at that cutoff. vendor reportedsource

                            Amada

                            LiamDB · GitHub weight release: 8 Nov 2026 · NON-COMMERCIAL

                            A CPU decision model family. Amada 3.1 uses mmBERT-base to answer yes/no, choice and ordered-score questions, with a separate probability that the text does not provide the answer for yes/no questions. Downloads pair an ONNX model with its tokenizer.

                            Base
                            mmBERT-base for 2.0 and later; ModernBERT-large for 1.0
                            Context
                            8,192 tokens for 3.x; 512 for 1.0 and 2.0
                            Licence
                            CC BY-NC-ND 4.0 for weights and repository code; non-commercial, no redistribution of modified versions
                            Access
                            Public release ZIP files and Python ONNX runner
                            • The maker reports 0.961 yes/no, 0.915 choice and 0.760 score accuracy on short English tests, using GPT-6 Luna labels. Human-labelled public-data results include SST-2 0.899 and Banking77 0.611. Half of the bake-off sets informed calibration, so the figures are not one untouched general benchmark. vendor reportedsource

                            JevAlt

                            Mert Kaya (Eschatia Labs) · October weights; catch-up discovery: 1 Oct 2026 · OPEN

                            Three Intern-Decision-4B fine-tunes: Deem-4B for English, Karar-4B for Turkish and Wähler-4B for German. They return per-option probabilities through the System One API. Optional extensions add unknown, conformal answer sets or a short generated reasoning trace; reasoning is off by default. This is a catch-up October release.

                            Size
                            4B per language model
                            Inputs
                            Text; English, Turkish or German by model
                            Limits
                            8k context; up to 62 choice options; score uses 2 to 10 levels
                            Licence
                            Apache-2.0 code and weights; dataset terms remain separate
                            Access
                            Full weights, Q4_K_M/Q5_K_M/Q8_0 GGUF, Transformers and llama.cpp server
                            • The maker reports Deem-4B accuracy 94.7% and Brier 0.091 on held-out English decisions from the same pipeline as training. In 11 held-out missing-fact cases, both JevAlt and its Intern-Decision base choose unknown in 9; this does not establish a fine-tuning gain. A separate 4 Oct live test records 122/130 correct. vendor reportedsource
                            • The Deem Q4_K_M file is 2.71 GB; the maker measures peak RAM of 3.04 GB at 4k context. The maker reports Q4_K_M selected-option agreement with full precision of 95.2% to 97.5%, on 62 English, 61 Turkish and 40 German validation decisions. These are tested configurations, not universal hardware minima. vendor reportedsource

                            Rein-NPC-4B

                            jmc0 · Hugging Face weight release: 8 Nov 2026 · OPEN

                            A Qwen3.5-4B chat checkpoint with a decision readout trained through 64 added token embeddings. The original backbone weights stay frozen; a separate copy of the output table keeps the trained input rows out of chat generation. Rule questions read option-letter probabilities, while the same model file also writes dialogue. A decision still needs a prefix pass over the conversation; it is not free work inside an ordinary chat response.

                            Base
                            Qwen/Qwen3.5-4B
                            Inputs
                            Text conversations, personas and rule sheets
                            Runtime
                            Transformers; a separate GGUF package uses llama.cpp chat and completion endpoints
                            Licence
                            Apache-2.0; licence file included
                            Access
                            BF16 weights, decision protocol and GGUF variants
                            • The maker reports 0.958 accuracy and 0.002 ECE on 28,433 synthetic questions about rules excluded from training, with model-audited labels. A separate 1,352-question author-written set scores 0.924. The card's headline and detailed table disagree on some baseline and end-to-end figures, so no numerical end-to-end improvement is asserted here. Situation-triggered tool calls remain a stated weakness. vendor reportedsource

                            Laya Descent v4

                            Eren Terakye · Hugging Face weight release: 8 Nov 2026 · OPEN

                            A Laya fine-tune that copies a scripted lunar-lander autopilot for Low Gate. The package supplies PyTorch weights, the MLX conversion used in the benchmark, training data and hashes. It is an artifact for one simulator and prompt, with manoeuvres selected from a fixed menu.

                            Base
                            convaiinnovations/laya at revision 7b928d828b7b0e022f929d9bd2e44165aa270148
                            Inputs
                            Text game states and manoeuvre questions
                            Licence
                            Apache-2.0; base licence and modification notice included
                            Access
                            PyTorch and MLX checkpoints, data and training report
                            • The maker reports 142 landings out of 160 levels on courses 5001-5020, excluded from training and tuning. The training report separately contains 2 overlapping items among 2,728 evaluation rows. PyTorch and MLX choose the same manoeuvre on 5,795 of 5,801 recorded states; this open-loop parity check does not fly new courses. vendor reportedsource

                            Chinese Decision Pointer 4B

                            quincyqiang / yanqiangmiffy · Hugging Face weight release: 8 Nov 2026 · OPEN

                            A Qwen3.5-4B LoRA fine-tune with a pointer head that scores markers beside the supplied candidates. Multiple questions about one state share a sequence. The pointer readout removes the letter-based 26-option cap, but all input still has to fit the runtime. The model selects among supplied options and has no abstention mechanism.

                            Base
                            Qwen/Qwen3.5-4B; merged BF16 LoRA
                            Inputs
                            Text state and candidate questions; Chinese and English
                            Readout
                            256-dimensional pointer head; fitted temperature 1.538
                            Licence
                            Apache-2.0 weights; source datasets retain their own terms, including non-commercial or research-only terms
                            Access
                            Merged model.safetensors with loading and evaluation code
                            • The maker reports public Decision Index 0.3 skill 61.69 and raw 71.01 over 140,178 requests. The saved scores contain 140,177 ok responses and one unsupported response. Candidate-order debiasing averages original and reversed orders, so the reported 64.2 ms median and 147.3 ms mean on an A800 include that recipe. The maker describes 13-word overlap filtering; this is not an independent contamination audit. vendor reportedsource

                            Aster-JEV-27B

                            k2021211255 · Hugging Face weight release: 8 Nov 2026 · OPEN

                            A full-parameter Qwen3.8-27B vision decision fine-tune with a separate head and a frozen evaluation engine. A forward pass returns probabilities across supplied choices without generating text. The released package includes weights, inference code, manifests and full public vision-suite records.

                            Base
                            Qwen/Qwen3.8-27B
                            Inputs
                            Text and images; 2 to 26 choice options
                            Limits
                            262,144 input tokens; up to 1,638,400 pixels per image, subject to device memory
                            Licence
                            Fine-tuned weights CC BY-NC 4.0; original backbone Apache-2.0
                            Access
                            BF16 backbone, FP32 stored head and single-A800 inference recipe
                            • The maker reports public Vision Index 76.7057 with 9,867 of 12,210 requests correct. Pooled across eight parallel processes, each on one A800 80 GB, synchronized forward timing has 361.5 ms median, 507.2 ms mean and 581.9 ms p80, excluding preprocessing and transfers. The official private evaluation and RTX PRO 6000 timing check are pending; this is a self-scored public result. vendor reportedsource

                            Jevora 9B

                            kadirbekovvv / doxanocap · Pinned V1.6 package at 06:55 UTC; catch-up verification: 8 Nov 2026 · OPEN

                            A Qwen3.5-9B LoRA decision model with a separate 255-option head. The pinned V1.6 package returns one zero-based choice and ordered probabilities through POST /decision. It needs the public custom loader; it does not generate explanations or tool calls. The package predates this scan window, while the availability clarification appeared during it.

                            Base
                            Post-trained Qwen/Qwen3.5-9B; rank-64 LoRA and a separate BF16 decision head
                            Inputs
                            Text context and 2 to 255 ordered, non-empty options
                            Limits
                            8,192 rendered tokens; no silent truncation
                            Licence
                            Apache-2.0 project code and derivative weights; upstream components and datasets retain their terms
                            Access
                            Pinned complete V1.6 package at revision 545549b8e8104f1780966ef1c13136abb32712b4; custom Python 3.13 loader
                            • The maker reports public Decision Index 0.3 skill 49.83 and balanced raw score 62.28: 140,299 of 140,620 requests answered, with 321 unsupported and no errors. Development data selected update 71,327, so its 254/352 result is not an independent final test. V1.6 uses temperature 1 without fitted calibration. No private Full score or official rank is asserted. vendor reportedsource
                            • The card reports operator-run tensor parity and three cold CUDA research/public-loader checks with zero maximum probability difference. This scan checks the pinned file inventory, manifest hashes and checkpoint metadata; it does not repeat GPU inference or verify an independently published parity receipt. vendor reportedsource

                            Domyn-Edge-Jev-Decision

                            Mahesh Deshwal · Hugging Face weight package release: 8 Nov 2026 · OPEN

                            A 3.93B full fine-tune of Domyn-Edge-SFT for text decisions. It reads probabilities over option-letter logits in one forward pass. The card provides Transformers and vLLM recipes; the served vLLM path requests one output token. Its public JevBench submission is awaiting a sealed evaluation.

                            Base
                            domyn/Domyn-Edge-SFT; 3,928,787,968 stored parameters
                            Inputs
                            Text state and Choice, Noul or Score questions
                            Context
                            16,384 tokens used in training, per the card
                            Access
                            FP32 safetensors and custom Transformers code
                            Licence
                            Apache-2.0 declared in the card; no separate package licence file
                            • The current card reports public-only composite 78.78 and claims second place in JevBench v1.8.7, with sealed evaluation pending. These are the maker's tables; no official board placement is established here. The bundled eval_report.json remains a separate 6,355-item report with raw accuracy 0.8017. vendor reportedsource

                            Clashbot d1-ft-joint-tac

                            Jyler · Hugging Face weight package release: 9 Nov 2026 · OPEN

                            A fine-tune of Liquid AI’s d1-omni-600M for a Clash Royale course project. It reads a text game state and up to four candidate plays, including tactical notes, retrieval and knowledge-graph context. The package selects a play; the surrounding agent uses iPhone Mirroring on a Mac. Intended for research and the course demo in Training Camp or friendly battles.

                            Base
                            LiquidAI/d1-omni-600M; 587,161,089 stored parameters
                            Inputs
                            Text game descriptions and up to 4 candidate plays
                            Training
                            3,641 four-option questions from 197 recorded professional games; splits by video
                            Access
                            FP16 weights and bundled custom loader; CPU loading uses FP32
                            Licence
                            LFM Open License v1.0; file included
                            • The maker reports four-way accuracy 0.507 on 766 test lines from 27 held-out games, against chance 0.25 and a placement prior 0.384. The reported 95% interval is 0.473 to 0.540. FP16 and FP32 choose the same option on 100 check lines. These are offline play-choice results, not a measured live-game win rate. vendor reportedsource

                            QEV Compact

                            Ken Jo · Hugging Face weight release: 9 Nov 2026 · OPEN

                            Two pruned QEV v3 models for text and image questions. The maker removes eight of 24 language-model blocks and trims the input vocabulary to 32,768 rows, then distils a decision readout. They return option probabilities, a typed answer and a separate abstain flag. Ken Jo's QEV family is separate from labqoat's Qev 0.8B.

                            Sizes
                            466,313,408 and 1,314,213,824 parameters, per the cards
                            Inputs
                            English text and up to four images; Choice, Noul and Score
                            Context
                            8,192 input tokens; over-budget requests refused
                            Runtime
                            Bundled backbone and head; pinned qev Python loader on CUDA, accurate mode only
                            Licence
                            Apache-2.0 files included; training datasets retain their own terms
                            • The maker reports public vision index scores of 52.52 and 62.15 on 12,210 rows across 11 benchmarks, versus 52.70 and 62.27 for the corresponding full-depth parents. These are public-only normalized scores, not accuracy percentages; private-half results are pending. vendor reportedsource
                            • On an RTX 4060 Ti 8 GB at batch 1, the maker reports peak GPU memory of 1.15 GiB and 2.76 GiB, with median p50 timings of 54.4 ms and 99.0 ms across 47 request profiles. Calibration and abstention thresholds were fitted on development data; the empirical error target is not a guarantee on new data. vendor reportedsource

                            Julia 1

                            Supersonic Labs · Published weights and Python runtime; September catch-up: 25 Sep 2026 · OPEN

                            A 144.3M-parameter multilingual encoder adapted from mmBERT-small to score supplied options. It accepts named Choice, Noul and ordered Score questions, with a Python runtime for CPU or CUDA. This September release was found through an overnight card edit.

                            Size
                            144,292,870 stored parameters; FP32 weights
                            Inputs
                            Text state and 2 to 20 options per native question
                            Context
                            8,192 combined tokens supported by the runtime; historical accuracy tests used 1,024
                            Access
                            Open weights and packaged Python inference code; private training pipeline
                            Licence
                            Apache-2.0 declared in the card; no separate package licence file
                            • The maker reports 1,463/2,000 typed questions correct on H200 BF16. A separate CPU FP32 reproduction gets 426/600 Choice, 542/800 Score and 483/600 Noul. Jev figures in the card are supplied references, not newly matched calls; an 8,192-token smoke test does not establish accuracy at that length. vendor reportedsource

                            Strands Decider 2B v1

                            Strands Labs · Hugging Face weight release: 9 Oct 2026 · OPEN

                            A LoRA adapter and option-scoring head on Qwen3.5-2B-Base for Choice, Noul and Score questions. This v1 release averages three training runs and supplies a System One server. Its optional vision path keeps the base vision tower without image training. The community SageMaker project deploys the separate Strands Decider 2B hobson-v19 checkpoint.

                            Base
                            Qwen/Qwen3.5-2B-Base; separate base download required
                            Inputs
                            Text; optional image path needs the vision extra and a runtime release after 0.1.0
                            Runtime
                            strands-decider Python package, CPU, MPS or CUDA; POST /v1/systemone
                            Licence
                            Apache-2.0; LICENSE.md included
                            • The maker reports 180/231 public JevBench tasks correct at a 4,096-token serving window, Brier 0.280 and ECE 0.072. CPU and NVIDIA L4 select the same answers on all 231 tasks; the training harness differs on one near tie. These are maker runs, not an independently reproduced board score. vendor reportedsource

                            ZeroPoint

                            Javier Marín · First published package release; October catch-up: 31 Oct 2026 · OPEN

                            A CPU decision model that scores supplied options against a fixed zero-energy none state. It packages an encoder derived from multilingual-e5-small, ONNX weights and a fitted head. Its runtime sorts options into a canonical order before scoring, so order consistency belongs to the complete serving path.

                            Size
                            89 MB model files, per the maker
                            Inputs
                            Text and option labels; no free-form generation
                            Limits
                            Reads 192 text word pieces and 16 per option, with truncation flags; options processed in blocks of 20
                            Access
                            Bundled model files; Python with NumPy, ONNX Runtime and tokenizers
                            Licence
                            Apache-2.0 code; upstream multilingual-e5-small is MIT, with notices
                            • The maker reports 53.6% correct decisions including none across 900 matched cases, half with no right option, versus 58.6% for Strands Decider 2B v1. ZeroPoint takes a 42 ms median on a two-core CPU with two threads; Strands uses an NVIDIA L4 in that comparison. These timings do not compare raw speed on the same hardware. vendor reportedsource

                            MANTA

                            Gevaert Lab · Hugging Face weight release: 10 Nov 2026 · OPEN

                            Medical decision models in two sizes, built on Qwen3.5-4B and Qwen3.8-27B with a trained decision head. They read text and images and return probabilities for each supplied option. These are research models; the card requires independent validation and clinician review before patient decisions.

                            Sizes
                            4B and 27B backbones; the 4B package stores 5,287,287,300 parameters, including a copy of the tied output embedding
                            Inputs
                            Text or JSON with optional images; up to 64 questions and 4,096 prompt tokens
                            Access
                            BF16 weights, custom Transformers code and a Python request wrapper
                            Licence
                            Apache-2.0 files included; source datasets retain their own terms
                            Memory
                            The maker reports about 16 GB GPU memory for 4B and 60 GB for 27B
                            • The maker reports 86.1% accuracy for both sizes on the same 6,700-question medical comparison subset. On its 554 out-of-domain questions, 4B scores 71.5% and 27B 74.4%. These are constructed benchmark questions, not prospective patient outcomes. vendor reportedsource
                            • The maker reports median request latency of 68 ms for 4B and 148 ms for 27B on one H100 at batch size 1. Hosted-model timings in the card exclude client networking, so they are not end-to-end comparisons. vendor reportedsource

                            N-Q-26M-JEV

                            Q Project · Hugging Face weight release: 10 Nov 2026 · OPEN

                            A small Russian/English decision model with a custom hybrid backbone and decision head. The 1110 checkpoint adds toxicity and profanity training. It scores supplied options, with reversed-order averaging enabled by default; that serving choice uses two orders.

                            Size
                            The card lists 29.7M parameters plus 16.8M n-gram parameters, despite the 26M name
                            Inputs
                            Russian and English text; choice, yes/no and score questions
                            Limits
                            Reads the first 1,536 state tokens; training-family wording is recommended
                            Access
                            Transformers custom code; safetensors and QPACK files
                            Licence
                            Q Project Model License 1.0: free non-commercial use; commercial use, including internal use, needs a paid licence. Company evaluation is allowed for up to 90 days without production or customer use.
                            Data terms
                            The card identifies non-commercial ANLI data and toxicity data without a stated licence; third-party terms still apply
                            • The maker reports 45.9 on the 231-task public JevBench v1.2 run, down from 46.3 for 1027. Its reported Russian/English toxicity accuracies are 96.1%/90.1%; harmless English uses of violent words remain failure cases. These task results do not establish general reasoning ability. vendor reportedsource

                            GameDecider

                            Holdout Labs · Hugging Face weight release: 9 Nov 2026 · OPEN

                            An English game-scene decision model derived from Ettin-400M, with ONNX files and a Python runtime. It scores NPC intent, mood and quest questions, with optional abstention and 42 compiled adapters. The runtime adds option-order averaging and a minor-safety guard; raw ONNX does not include either.

                            Inputs
                            Text or JSON game scenes; choice with 2 to 32 options, score with 2 to 10 levels, and yes/no
                            Limits
                            3,072 state tokens; two-option choices and choices with 11 or more options never abstain under the published profiles
                            Package
                            792.5 MB default fp16-weight ONNX file; Python runtime 0.1.0
                            Licence
                            Apache-2.0; upstream Ettin-400M is MIT
                            Scope
                            Fictional game situations; the card excludes consequential decisions about real people
                            • The maker reports 60.0% accuracy on 2,993 private questions from unseen task families with option-order averaging. Default thresholds cover 66.2% of that set, versus 97.4% of dev questions. The private evaluation sets and training rows are not released. vendor reportedsource
                            • On an AMD Ryzen 5 3600X, the maker reports warm model p50 0.92 s for one question in a single option order and 1.80 s with default choice-order averaging. The 200 held-out rows have a median 325 tokens. vendor reportedsource

                            MNN-Pocket-0.3B-Dec

                            Taobao MNN · First published Hugging Face package; October catch-up: 15 Oct 2026 · OPEN

                            A text decision package with the MNN-Pocket-0.3B backbone, an unmerged LoRA adapter and a pointer head. It returns probabilities for supplied choices, yes/no questions and ordered scores. The bundled Transformers/PEFT runtime keeps the full backbone and language-model head.

                            Package
                            723 MB backbone, 28.7 MB adapter and 1.8 MB decision head, per the card
                            Inputs
                            Chinese and English text; up to 255 candidates per question
                            Context
                            32,768 request tokens; longer requests raise an error instead of truncating
                            Access
                            Bundled Python runtime; CPU float32 or supported GPU dtypes
                            Licence
                            Apache-2.0 file included
                            • The maker fitted a temperature of 1.1112 on a 600-question calibration partition, reducing pooled NLL from 0.8598 to 0.8576. This calibration fit does not establish held-out task accuracy or phone performance. vendor reportedsource

                            ARC 1.0

                            Rayline · Hugging Face weight release: 10 Nov 2026 · OPEN

                            A Qwen3.5-0.8B-derived router that predicts model success and token use separately from the prices supplied by an application. The package includes routing and content-signal heads plus a general question head. Sage and Swift are policies on the same model.

                            Base
                            Qwen/Qwen3.5-0.8B; specialized heads use the lower 12 layers, while the question head uses all 24
                            Inputs
                            Agent conversation and developer-defined questions with answer options
                            Access
                            Open weights and hosted arc-sage-1.0 / arc-swift-1.0; public vllm-arc plugin is unfinished
                            Serving
                            Stock vLLM cannot load the architecture alone. The public plugin supports encoder integration and Stage-1 scoring, without the complete policy, question or content-signal APIs
                            Licence
                            Apache-2.0; LICENSE and NOTICE included
                            • The maker defines utility as value of success times predicted success minus expected cost. Sage uses value 4.5 and Swift 0.1. Prices are supplied at runtime; the package contains no price snapshot. vendor reportedsource

                            GS1

                            BIGAI · Hugging Face weight release: 10 Nov 2026 · OPEN

                            A four-size family with Qwen3.5 hybrid backbones and native decision heads. It scores supplied candidate meanings for Choice, Noul and Score questions without generating text. Published decision results are text-only; retained vision components do not establish image accuracy.

                            Sizes
                            0.8B, 2B, 4B and 9B releases; the 2B card lists 2,319,227,200 stored parameters
                            Runtime
                            Custom Transformers code with AutoModel and trust_remote_code, or the GS1 HTTP server
                            Context
                            Configured branch limits: 65,536 tokens for 0.8B/2B/4B and 32,768 for 9B; default HTTP service limit is 4,096
                            Calibration
                            Released configurations use identity calibration; task-specific confidence still needs validation
                            Licence
                            Apache-2.0 code and weights; LICENSE and NOTICE included
                            • The maker reports GS1-2B scoring 62.22 on public Decision Index 0.3 across 37 benchmarks, and 80.09% on 231 public JevBench decisions. Public task accuracy is separate from the sealed composite. vendor reportedsource
                            • The maker reports GS1-2B warm in-process CUDA Graph p50 18.64 ms on an RTX 4090 reporting 48 GiB, using one question and a 256-token longest branch. Loading, graph capture, HTTP and SDK transport are excluded. vendor reportedsource

                            ANT

                            Semantique Team · Hugging Face weight release: 10 Nov 2026 · OPEN

                            Trained candidate-scoring heads for frozen Qwen3.5-0.8B and 4B backbones. Each package contains the head, temperature calibration and an execute-or-escalate policy, with a separate backbone download. The English/Italian training and evaluation situations are synthetic.

                            Package
                            Head-only releases; ANT-08B has 1,053,696 trainable parameters and a 4.2 MB head, excluding the backbone
                            Inputs
                            Text state, question and supplied candidates; configured context budget 1,024 tokens and 128 per candidate
                            Runtime
                            Python runtime from the matching ant-08b or ant-4b GitHub repository; optional MLX path
                            Status
                            Work in progress; one training run per size, without measured seed variance
                            Licence
                            Apache-2.0 for released heads; Qwen backbones retain their own Apache-2.0 licence
                            • The maker reports test accuracy 67.44% for ANT-08B and 73.92% for ANT-4B on 648 synthetic situations. On 456 situations from held-out use cases, accuracy is 57.02% and 59.65%. These are separate from the validation-fitted escalation policy. vendor reportedsource
                            • ANT-08B reports validation coverage 44.2% at 9.9% error among accepted decisions, using 688 validation rows. Its fitted threshold does not establish that error rate on new domains; OOD ECE is 0.220. vendor reportedsource

                            decider-ja 0.5B

                            ken11 · Hugging Face weight release: 10 Nov 2026 · OPEN

                            A Japanese decision adapter and pointer head trained on Sarashina2.2-0.5B with the Strands Decider recipe. It returns Choice, Noul and Score answers through strands-decider. This is a community release, with a separate base download or a merged Q8_0 GGUF.

                            Base
                            sbintuitions/sarashina2.2-0.5b
                            Inputs
                            Japanese text; training and request configuration use a 4,096-token maximum
                            Calibration
                            Temperature 1.0, without calibration; the card warns about long documents, arithmetic, neutral labels and surface-word effects
                            Training
                            200,156 rows for one epoch; translated public data and synthetic data. The mixed training rows and teacher distributions are not published
                            Licence
                            MIT; LICENSE.md includes the base and Strands code attribution
                            • The maker reports median inference 0.94 s for 224 tokens and three questions on AWS Lambda arm64 with 10,240 MB memory, six Graviton2 vCPUs and Q8_0 GGUF. A separate roughly 220-token one-question test reports median 0.38 s and p95 0.58 s. vendor reportedsource

                            Ainvest Decision 31B v2.0

                            Ainvest-World · Hugging Face weight release: 11 Nov 2026 · OPEN

                            A text-only Gemma 4 31B fine-tune that scores supplied option tokens without generating an answer. It reads complete inputs twice when they are at most 3,000 tokens before repetition, handling each question separately. The package includes full BF16 weights and its inference code.

                            Base
                            google/gemma-4-31B-it; full-parameter backbone training with token embeddings and output head frozen
                            Inputs
                            Text Choice with 2 to 255 options, or Noul; up to 64 questions per request
                            Context
                            262,144 rendered tokens per question, including repetition and template; unsupported questions reject the whole request without truncation
                            Access
                            16 BF16 weight shards, approximately 62.55 GB before runtime overhead; CUDA package and CLI
                            Licence
                            Apache-2.0 release; retain base-model and MIT helper notices
                            • The maker describes training on more than 2 million cleaned text-decision examples with teacher-generated soft labels. The public score is reused from an earlier full run; publication checks do not constitute a fresh full benchmark. vendor reportedsource

                            newTokenEra decision 27B

                            NewTokenEra · Hugging Face weight release: 11 Nov 2026 · OPEN

                            A Chinese/English post-trained Qwen3.8-27B decision model with full BF16 weights. Its decide method scores a 26-slot decision head once per question and returns Choice, Noul or Score answers, without generating text. Its reported N-bank evaluation was also used during interface development.

                            Base
                            Qwen/Qwen3.8-27B; upstream revision recorded in provenance.json
                            Inputs
                            Text or JSON state; 1 to 64 questions; Choice has 2 to 26 options and Score has 2 to 10 ordered levels
                            Context
                            4,096 tokens per rendered question; longer inputs raise an error rather than truncate
                            Access
                            18 BF16 weight shards, about 52.17 GB before runtime overhead; custom Transformers code with trust_remote_code
                            Calibration
                            Probabilities are conditional on supplied alternatives; downstream-domain calibration is unmeasured
                            Licence
                            Apache-2.0; actual LICENSE included
                            • The maker reports 1,311/1,340 classification and Boolean decisions correct on the development N bank. Its 120 tied mixed decisions are excluded from accuracy; the 300 rating prompts use a separate MAE metric. This is a same-bank regression check. vendor reportedsource

                            ProbeLoop Laya stated limits

                            submsk · Hugging Face weight release: 10 Nov 2026 · OPEN

                            A provisional Italian sentence classifier fine-tuned from Laya multilingual. It finds explicit statements of missing knowledge or experience in interview-practice answers. This is a fixed two-class encoder and head, separate from Laya’s general typed-question heads; it does not assess competence or choose interview moves.

                            Size
                            306,941,186 parameters; full float32 weights and a 308 MB dynamic-int8 ONNX export
                            Inputs
                            One answer sentence paired with the last 300 characters of the interviewer’s question; 192-token truncation
                            Runtime
                            ONNX Runtime, Tokenizers and NumPy on CPU; no Laya SDK required
                            Training
                            2,549 synthetic Italian sentence pairs, 362 positive; final checkpoint trained on all rows
                            Calibration
                            Threshold 0.5; no calibrated confidence guarantee or real-interview acceptance test
                            Licence
                            Apache-2.0 fine-tuning and exports; retain Laya and mmBERT upstream attribution
                            • The maker reports 288/294 positive answers found and 8/312 negative answers flagged in a synthetic leave-one-profession-out pilot. Those results concern held-out-group models, not an unseen test of the final checkpoint trained on all rows. vendor reportedsource

                            Gemini Decision 1

                            Google DeepMind · Google announcement: 11 Nov 2026 · API

                            A multimodal decision API for text, images, audio, video and PDFs. It returns yes/no probabilities, a choice or a rubric score without generating text. Questions share the input but cannot see each other’s answers; application code combines the results.

                            Price
                            Google reports $0.10 per million input tokens; output free. Shared input billed once, plus each question's instructions and criteria · Compare prices
                            Inputs
                            Google reports support for text, images, audio, video and PDFs; the 262,144-token context includes shared input and all questions
                            Questions
                            Google reports up to 1,000 independent questions per request; 2 to 255 choice options or ordered score levels
                            Access
                            Gemini API in Google AI Studio, including a no-cost prototyping tier; listed on OpenRouter
                            Limits
                            No text generation, function execution, caching or Batch API support. Google reports yes/no probabilities from 0.01 to 0.99
                            Media billing
                            Google’s launch lists no separate audio transcription or OCR charges
                            • Google reports 150 to 250 ms end-to-end latency for inputs up to 16K tokens, nearly flat from 1 to 100 questions. Those measurements do not cover the maximum context or question count. vendor reportedsource
                            • Singularity Feed’s independent test asks 1,000 yes/no questions over one 1,000-sentence input. The author reports 92.5% accuracy and median 3.996 seconds across five requests, with estimated cost $0.006743 per request. This tests a shared-input workload, not 1,000 separate documents. independentsource

                            femto-jev

                            igorktech · Hugging Face weights, 15:42:55 UTC: 11 Nov 2026 · OPEN

                            A small typed-decision encoder for text, with a separate femto-asr speech frontend. It scores options in a forward pass per question. The maker’s speech tests show that audio frames help on familiar recording conditions but add no benefit on unseen phone speech.

                            Size
                            Maker reports 7.7M decision-model parameters and 30 MB fp32 weights; speech frontend adds 2.39M parameters
                            Inputs
                            The maker reports text or 16 kHz mono speech input through femto-asr; choice, yes/no and score questions
                            Access
                            Public weights and single-file Python inference; no text generation
                            Licence
                            Apache-2.0, with upstream notices
                            Limits
                            English; out-of-list spoken commands are not reliably rejected. Confidence is not an out-of-distribution rejection guarantee
                            • The maker reports 73.2% accuracy across 400 typed-decisions test cases containing 2,000 decisions. The model trained on that dataset’s training split. SLURP accuracy is 71.4% with transcript plus frames, against 58.6% with transcript alone; on unseen MInDS-14 phone speech the figures are 55.8% and 56.1%. vendor reportedsource

                            Laya medical specialty

                            AI Anytime · Hugging Face weight upload, 19:54:59 UTC: 11 Nov 2026 · OPEN

                            A Laya fine-tune that assigns clinical notes to a fixed menu of medical-specialty and document-type labels. Snapcall supplies the loader and System One server. Its published test concerns document classification; it does not validate diagnosis or clinical care.

                            Base
                            convaiinnovations/laya, fully fine-tuned with Snapcall
                            Inputs
                            AI Anytime reports text-only choice classification over 40 supplied labels
                            Access
                            Public backbone and decision-head safetensors; load or serve with Snapcall
                            Training
                            AI Anytime reports 4,023 training, 447 validation and 496 test examples from galileo-ai/medical_transcription_40
                            Licence
                            Apache-2.0 according to the card; dataset terms remain separate
                            • AI Anytime reports 64.31% test accuracy, macro-F1 0.5706 and 15-bin ECE 0.0480 on 496 examples. Temperature scaling uses the validation split; calibration must be checked again on new traffic. vendor reportedsource

                            Claims are marked vendor-reported until someone independent reproduces them. Inclusion is not endorsement, and nobody pays to be listed. Something missing or wrong? if@decisionmodels.ai

                            Projects

                            Public projects built on decision models

                            Each one opened and checked against its own repo, with star counts as of the day each was added. Jev, released on 15 September 2026, is behind 102 of the 172 projects; the other 70 run on 36 other named models, or on models people load locally. Checked 03 Nov 2026, GitHub search returned 11,206 public repositories matching "jev" created from 15 to 30 September, and 27 created from 11 to 14 September.

                            Hindsight agent memory

                            Source: vectorize-io/hindsight ↗

                            Hindsight uses hs-decide-1-flash to prune and deduplicate recall, check whether evidence answers a request, consolidate new facts and decide whether a memory could change a knowledge page. It first tried this with Jev. In the team's own Hindsight 1.2.0 evaluation, glm-5.3-flash plus the decision model scores 87.1 at $7.72 per thousand cases, against 89.0 at $147 for gemini-3.8-flash alone. Reflect quality falls with some LLMs. gemini-3.1-flash-lite judges all runs and also appears in the comparison.

                            Vectorize · ★ 58,477 · MIT · hs-decide-1-flash

                            • memory
                            • agents

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Launch and evaluation → Source: MIT licence →

                            Ultra-fast browser agent

                            Source: browser-use/jev-ultrafast ↗

                            Zurich to London on Google Flights in 7.1 seconds, including model calls, generated text, browser work and loading waits. Swapping to a decision model took median task time from 9.450s to 7.092s and median browser protocol calls from 1,092 to 101.

                            One natural-language goal, on the real web, at 1x speed. Maker-reported: three repeats of one task on one browser profile.

                            • 7.09 smedian task, down from 9.45 s
                            • 101browser calls, down from 1,092

                            browser-use · ★ 23,396 · MIT · Jev

                            • browser
                            • agent

                            Figures from the project's own README and docs/performance.md. The maintainers note this is three repeats of one task on one browser profile, not a general benchmark.

                            Source: GitHub → Source: Measurements →

                            Jevgrep code search

                            Source: dzhng/jevgrep ↗

                            A CLI that uses Jev to find source files and context for coding agents. Its author-run ten-task study reports 25.8% lower estimated total task cost with 8/10 solves in both conditions. A later change cut Jev cost about 59%, but raised combined cost 2% to 3% against that saved cohort, again with 8/10 solves.

                            David Zhang · ★ 3,199 · MIT · Jev

                            • code search
                            • coding agents

                            Catch-up September experiments, discovered through an in-window push. The ten Python tasks were repeatedly studied; saved baselines were not rerun. Costs include failed attempts and use list-price estimates, not reconciled invoices. Nineteen empty responses leave some later usage unknown; the report gives a ceiling.

                            Source: GitHub → Source: Licence → Source: Total-cost run → Source: Later combined-cost study → Source: Provider code →

                            OAK4 visual questions

                            Source: luxonis/oak-examples ↗

                            YOLO-E locates objects and a local d3-lite Q8_0 model answers up to four typed questions per crop. The standalone RVC4 app keeps live video separate from the background decision worker and shows the input crop beside its answer. Luxonis publishes a warehouse demo and reports on-device tests, without matched accuracy or crowd-throughput measurements. Requires Luxonis OS 1.40 or newer.

                            Luxonis · ★ 983 · Apache-2.0 application code; model and dependency terms separate · d3-lite

                            • vision
                            • local

                            Vendor demo and on-device execution report; not independently reproduced

                            Source: Application licence → Source: Runtime → Source: Demo and requirements → Source: On-device report →

                            fastbrowse: a browser agent where Jev picks each action

                            Source: agent-labs-dev/fastbrowse ↗

                            An LLM plans, reads and writes; Jev picks each action from the controls indexed on the page, and code stops irreversible clicks without authorization. On 46 tasks run three times each against the hosted Browser Use agent, it passed 99.2% of runs to 96.3% and cost $0.0296 a run to $0.3180, 10.7x less, but was slower: 18.9 s a task to 15.3 s (published campaign release-0.7.1).

                            agent-labs-dev · ★ 155 · MIT · Jev

                            • browser
                            • agent

                            Visual inspection workbench with Laya

                            Source: uu889/laya-opencv ↗

                            A local inspection workbench: OpenCV measures the image, hard rules decide anything numeric, and a Laya decision model cross-checks the result. Built for fruit picking, weed and pest monitoring, and steel pipe and textile checks. Version 3.0 also trains your own Laya-format decision models.

                            uu889 · ★ 58 · MIT · Laya

                            • inspection
                            • vision

                            laya-guard: review shell commands before they run

                            Source: scs0209/laya-guard ↗

                            Checks coding-agent tool calls with rules and a local multilingual Laya fine-tune, returning allow, review or block. VENDOR-REPORTED, base to fine-tune: the model alone held 32 then 39 of 43 attacks and allowed 25 then 44 of 50 everyday commands. Six end-to-end verdicts improved and two worsened, missing a preset no-regression criterion. Accuracy on 162 held-out training rows rose from 0.611 to 0.852. The author inspected the benchmark and evaluation sets between training runs, so they are less independent than a fresh test.

                            scs0209 · ★ 35 · MIT · Laya

                            • guardrails
                            • shell
                            • local

                            Source: Fine-tune and evaluation →

                            Flide decision inference

                            Source: OmniJev/Flide ↗

                            An inference engine that shares state processing across question branches and serves /v1/systemone. In the email demo checked on 12 Nov 2026, the team reports eight questions per email with OneJev1.6-0.8B in bfloat16 on one H200, and 28 seconds for 10,000 emails from 64 clients. This is a throughput example, not a spam-accuracy result.

                            Flide team · ★ 35 · Apache-2.0 · Local decision models

                            • inference
                            • tooling

                            Author-run records; no fresh model inference reproduced

                            Source: Licence → Source: Server → Source: Verification code → Source: Email demo and timing setup →

                            Telegram spam moderation

                            Source: backmeupplz/jev_antispam_bot ↗

                            A Telegram bot that checks spam and links related messages before deleting them, with admin exemptions and a keep-on-failure policy. Its published evaluation records 75 live Jev calls, including two rejected prompt changes. Those calls did not exercise Telegram deletion. The README says its production classifier is now a Laya fine-tune distilled from Jev.

                            Nikita Kolmogorov · ★ 21 · MIT · Jev, Laya

                            • moderation

                            Licence, implementation and recorded live model calls checked 6 Nov 2026; no fresh Telegram run.

                            Source: Licence file → Source: Integration code → Source: Recorded model calls →

                            Venn

                            Source: markrussinovich/venn-vdm ↗

                            A decision layer over reusable embeddings and recorded outcomes. Its download-free CPU quickstart uses authored vectors; text input needs a separate frozen reader and trained head. Code, an arena runner and a recorded-run manifest are public. The head has separate redistribution permission, and the docs warn that probabilities are not calibrated across tasks.

                            Mark Russinovich · ★ 17 · MIT code; trained head has separate redistribution terms · Venn

                            • embeddings
                            • routing
                            • local

                            Maker's code and recorded runs · VENDOR-REPORTED; not independently reproduced

                            Source: Licence → Source: Recorded arena run → Source: Head and reader terms →

                            Nouli: multi-turn sessions for decision models

                            Source: nouli-ai/nouli ↗

                            Decision models forget everything after each answer; Nouli keeps a session. Type facts as you learn them and start a line with ? to ask a new question; earlier facts and answers stay in the history. A Rust CLI and library that can chain sessions into decision graphs, with Jev through its TypeSafe adapter or other providers.

                            nouli-ai · ★ 12 · MIT · Jev

                            • cli
                            • rust

                            ZeroPoint CPU decisions

                            Source: Javihaus/zeropoint ↗

                            Scores option labels and an implicit none state using a bundled ONNX encoder and fitted head. The maker publishes saved comparisons, model hashes and fitting code. Canonical option sorting and one-case inference are part of its consistency recipe. The 900-case matched comparison reports 53.6% correct including none, with half the cases having no right option. Short input budgets and truncation flags remain explicit.

                            Javier Marín · ★ 12 · Apache-2.0 · ZeroPoint

                            • decision-model

                            Source: Licence → Source: Saved run tables →

                            Guardrails for coding agents' bash commands

                            Source: berget-ai/guardrails-md ↗

                            A small decision model scores every bash command against your GUARDRAILS.md in about 100 ms (maker's figure), before an opencode, pi or Claude Code agent runs it. Commands scoring above the threshold for data loss, secret leaks or rule breaks are blocked; the README warns it can still let risky ones through.

                            Berget AI · ★ 11 · MIT · berget/bev (System One-compatible)

                            • security
                            • agent

                            Jev as a second pair of eyes for Claude Code

                            Source: Civalski/claujev ↗

                            A Claude Code plugin that asks Jev short typed questions while Claude works: how big is this request, is this command destructive, was the work really done. It suggests an effort level per request, and in enforce mode a confident check can block a "done!" when the work looks incomplete.

                            Civalski · ★ 4 · MIT · Jev

                            • coding
                            • agent

                            Slack Thread Police

                            Source: seanparkross/slack-thread-police ↗

                            A self-hosted Slack bot that privately suggests moving a channel message into a thread. Jev checks the recent message window by default; a local System One server can replace it. A person chooses whether to move or ignore the message. Debug logging can include Slack payload text.

                            Sean Park-Ross / Parklife, Inc. · ★ 4 · MIT · Jev

                            • slack
                            • messaging

                            README screenshots and integration code; not independently run

                            Source: Licence → Source: Detection code → Source: Privacy and model settings →

                            Practical Data table shading

                            Source: philrenaud/practical-data ↗

                            A Chrome extension asks a decision model which HTML table columns to shade and which end is better. Code parses values and paints the colours. The default free provider forwards table text to Jev; users can supply their own provider key or use its Cloudflare backend. The README reports colour-or-leave-plain matching 284 of 285 labelled columns on 26 pages. Labels and thresholds were tuned on those pages, so this is a regression check. The replay uses recorded model answers and does not retest the model.

                            Phil Renaud · ★ 3 · MIT · Jev

                            • tables
                            • browser

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: MIT licence →

                            PerfectRecall agent memory

                            Source: arslanrakh/perfect-recall ↗

                            A Hermes memory provider, Python library and MCP server that asks remote Jev to match stored memories against an agent’s criteria. A frozen predecessor scores 85.8% final-answer accuracy versus Mnemosyne’s 48.3% on a custom 120-question LongMemEval-S test. The renamed release has not had a fresh independent quality test; eligible memory text leaves the machine.

                            arslanrakh · ★ 3 · MIT · Jev

                            • evaluation

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            GitHub issues filtered in plain words

                            Source: BerriAI/better-backlog ↗

                            A local web page and CLI that reads a repo's GitHub issues and lets you filter them by typing a criterion, such as people blocked from upgrading. Each criterion is asked of a decision model through your TypeSafe key or a gateway; add another to narrow the list.

                            BerriAI · ★ 2 · MIT · Jev

                            • tooling
                            • web

                            Unorphan: loose files filed into their projects

                            Source: sushrutkhandelwal/unorphan ↗

                            A local app you point at a messy folder like Downloads: it works out which of your projects each loose file belongs to, reading the README or CLAUDE.md in your code folders, and files it into a matching folder under your chosen output location. Nothing moves until you press Move, and one click puts it all back.

                            sushrutkhandelwal · ★ 2 · no licence · Jev

                            • desktop
                            • files

                            System One in Swift

                            Source: rchatham/SystemOne.swift ↗

                            Native Swift and MLX inference for local d1 text, images and speech, with a shared HTTP server and an older von backend. The author publishes Python reference vectors and layer-by-layer parity measurements. Head-logit differences are 5.8e-5 absolute for d1 and 6.0e-5 for von. These are implementation checks, without a task-accuracy benchmark. The HTTP wire accepts text states; native Swift calls carry media.

                            Reid Chatham · ★ 2 · Apache-2.0; SystemOneD1 under LFM Open License v1.0 · d1, von

                            • developer tool

                            Author-run reference vectors and source checked 6 Nov 2026; not rerun locally.

                            Source: Licence file → Source: d1 terms → Source: Integration code → Source: Reference vectors → Source: Port verification →

                            On-device email triage

                            Source: patrikcze/mail-triage ↗

                            Classifies Apple Mail messages as for you, to review or junk with a Laya model running on your own computer, and shows a report of what it would do. Mail never goes to an external AI service, and it never deletes anything.

                            patrikcze · ★ 1 · Apache-2.0 · Laya

                            • email
                            • local

                            PathJev: decisions on pathology slides

                            Source: CosmoIknosLab/PathJev ↗

                            A decision model for histopathology: given a tissue image, a question and candidate answers chosen at run time, including 'none of these', it returns a probability for each in one forward pass. Built on MedGemma-1.5-4B with LoRA adapters and a decision head, with code to rebuild every number in the authors' preprint.

                            Cristian Tommasino and Antonio M. Rinaldi · ★ 1 · Apache-2.0 (code); weights for non-commercial research only (MedGemma HAI-DEF terms) · PathJev-P (own, MedGemma-1.5-4B base)

                            • medicine
                            • vision

                            MedJev: zero-shot medical decisions

                            Source: Simonlee711/MedJev ↗

                            Runs an open System One model locally on Apple silicon against ten medical benchmarks, from USMLE-style questions to emergency-department admission and 30-day readmission, and compares it with zero-shot LLMs and supervised baselines.

                            Simonlee711 · ★ 1 · MIT (code); model weights CC BY-NC 4.0 · OpenJev Flash 9B

                            • medicine
                            • benchmark
                            • local

                            Ants that draw your picture

                            Source: scalefreegan/jev-ants ↗

                            Each ant is a Jev agent that sees the cells around it and its neighbours' headings and decides which way to move and whether to settle. A thousand small decisions turn a random scatter into a word or an uploaded picture; the maker puts a word at about fifteen seconds and seven cents.

                            scalefreegan · ★ 1 · MIT · Jev

                            • art
                            • swarm

                            X spam blocker

                            Source: bit-cook/Jev-X-Blocker ↗

                            A Chrome extension that hides spam and noise in X posts and replies by combining Jev's probabilities for rules you write in plain language with local signals, and decides locally what to hide. Everything hidden can be restored in place, and if the API fails, posts are shown.

                            bit-cook · ★ 1 · MIT · Jev

                            • browser
                            • extension

                            UI tests written in plain English

                            Source: andletenkov/decisium ↗

                            Write test steps as plain-English Gherkin and Jev picks the element, action and check for each one from options Decisium reads off the page; code, not the model, decides whether a step passed. Resolved steps are recorded so CI can replay them with no model calls.

                            andletenkov · ★ 1 · MIT · Jev

                            • testing
                            • playwright

                            RealStop: catch work handed back by a coding agent

                            Source: decision-tune/realstop ↗

                            A Claude Code Stop hook with a local fine-tune of DecisionTune 1.0 that can block a turn ending that hands work back to the user. VENDOR-REPORTED on 864 test turn ends: the moderate setting caught 67.5% (195 of 289) of hand-backs at 15.8% false interventions, against 56.7% and 14.6% for phrase rules. That test split guided development. Both members were correct in only 16% (37 of 229) of synthetic pairs; the model did not beat phrase rules there. Warm model latency was a median 27 ms on an M5 Pro. The hook cannot verify claimed task completion.

                            decision-tune · ★ 1 · Apache-2.0 · DecisionTune 1.0 (RealStop fine-tune)

                            • coding
                            • guardrails
                            • local

                            Source: Model and evaluation →

                            LUAR spreadsheet review

                            Source: HayateV30/luar ↗

                            Labels spreadsheet text locally with Laya and exports answers, confidence values and review flags. On 300 texts per dataset, the author reports 93% English news-topic accuracy, 68% Portuguese review sentiment accuracy and 33% exact star-rating accuracy. The review labels come from customer ratings, which can disagree with the text.

                            HayateV30 · ★ 1 · MIT · Laya

                            • local

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            HN comment sorter

                            Source: ritza-co/hn-jev-sorter ↗

                            A Chrome extension that asks Jev to sort Hacker News comments into reader-defined buckets, retaining the parent comment as context. The author’s demo records a 131-comment thread being classified and sorted. Six requests run concurrently, and an Other bucket catches comments outside the chosen categories. The recording shows the workflow; it does not measure label accuracy.

                            Ritza · ★ 1 · MIT · Jev

                            • developer tool

                            Licence, integration code and author-recorded demo checked 6 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Recorded demo →

                            kneejerk native decision library

                            Source: moudrkat/kneejerk ↗

                            Moves llama.cpp decision serving code into a C library. Its recorded d1 request takes 678 ms on eight CPU threads. Saved CLI/server parity tests stay within 0.01 for Laya, exceed that probability tolerance for H2O and Clef, and reject the tested Perplexity package. On a Pixel 8a in Termux, the maker reports a 464 ms yes/no decision with d1-2B Q4_K_M on four threads and 2.1 GB RSS. Without repacking, that question takes 1,210 ms at 1.1 GB RSS. iOS and Capacitor app bindings remain plans.

                            Kateřina Fajmanová · ★ 1 · MIT · d1, Laya, H2O-Lightning-4B, Clef

                            • decision-model

                            Source: Licence → Source: Saved parity output → Source: Phone measurement and build notes →

                            Sentence to typed query plan

                            Source: saembit/jevquery ↗

                            A TypeScript library where Jev picks the table, columns, filter, order and limit from what the schema offers, so it can choose a column but never write a query. Drizzle, Prisma or a SQL builder turns the plan into a real, parameterised query.

                            saembit · ★ 0 · MIT · Jev

                            • sql
                            • typescript

                            Pet shop catalogue with evidence

                            Source: jeromtom/petsona-catalogue-ai ↗

                            Tags each pet product's species, life stage and allergens from the store's own text, asking Jev or Laya one typed question per value: supported, contradicted, unknown or conflicting, with the source sentence attached. Merchants can approve, correct and lock tags, or let a validated policy accept them automatically. A hackathon entry for AIBoomi Startup Weekend Kochi, 23-24 Oct.

                            Jerom Palimattom Tom (Rexin Dynamics) · ★ 0 · MIT · Jev, Laya

                            • e-commerce
                            • shopify

                            Politicians by Jev

                            Source: n8peace/politiciansbyjev ↗

                            Ask a question and Jev, via Vercel AI Gateway, gives each of 100 well-known American politicians a yes/no probability; the faces above the threshold float up out of a physics pile.

                            n8peace · ★ 0 · MIT (code); portraits under their own licences · Jev

                            • fun
                            • web

                            Live interview checklist

                            Source: ByronDarlison/call-coach ↗

                            A macOS app that transcribes both sides of a call on your Mac with Whisper while Jev ticks off each of your questions once it has been answered, notes which question you just asked, and flags surprising answers for a follow-up. The maker puts Jev's cost at about 1 to 2 US cents for a 45-minute interview.

                            Darlison Holdings · ★ 0 · MIT · Jev

                            • meetings
                            • mcp
                            • local

                            Voice tutor grounded in a textbook

                            Source: balajibankapur/textbook-voice-tutor ↗

                            Answers a seven-year-old's spoken questions from one scanned Grade 2 textbook chapter. Jev decides whether each new question can be answered from the chapter and, with the optional verifier on, whether the drafted answer's claims are supported by the retrieved passages; common questions are matched to cached answers. On the maker's 14-question test, the decisions API cut average answer time from 4.1 to 1.7 seconds and the cost of each gate call about 25 times, against the chat wrapper.

                            balajibankapur · ★ 0 · MIT · Jev

                            • education
                            • voice

                            Talk to your Mac in one sentence

                            Source: manikv723-jpg/JevVoice ↗

                            Speak several instructions in one run-on sentence and Jev picks each action from a menu of skills, and any app from those installed on your Mac, while you are still talking. Anything outside the menu goes to Claude for a proposed shell command, which waits for your approval unless you turn on trust mode.

                            manikv723-jpg · ★ 0 · no licence · Jev

                            • voice
                            • macos

                            A village run on Jev

                            Source: Dasge97/the-village ↗

                            A pixel-art village in the browser where Jev, via OpenRouter, chooses what each adult does for the next two hours, while fixed rules handle urgent needs, night-time sleep and children. The maker built it to test whether Jev's choices stay sensible and reflect each villager's personality.

                            Dasge97 · ★ 0 · MIT (code); CC0 1.0 (graphics and sounds) · Jev

                            • simulation
                            • game

                            PII discovery in plain SQL

                            Source: senthilsweb/jev-pii ↗

                            A DuckDB function that asks Jev typed questions about each database column: is it personal data, which kind, and whether GDPR, CCPA-CPRA, HIPAA, LGPD, PIPEDA or DPDP apply. Whether to keep, mask, hash or drop it is decided by code, not the model, and a failed call sends the column to review. Also runs in the browser.

                            senthilsweb · ★ 0 · Apache-2.0 · Jev

                            • data
                            • duckdb
                            • compliance

                            Search evaluation with Jev as judge

                            Source: rickcrawford/jev-relevancy ↗

                            Grades search results with Jev on a four-level scale, checked first against Amazon's human-graded shopping queries, and stores runs, results and judgments in DuckDB with the metrics computed in SQL. The author recommends checking it against at least 300 of your own labelled pairs before trusting it on another domain.

                            rickcrawford · ★ 0 · MIT · Jev

                            • search
                            • evaluation

                            decisions, an R package and web app

                            Source: fmegahed/decisions-space ↗

                            A Hugging Face app built on the R package decisions: upload a set of images or texts, ask Jev one question about each, and get every answer with its probabilities plus the R code to repeat the run. Visitors need no key or account; runs are checked against estimated session and daily budgets.

                            fmegahed · ★ 0 · MIT · Jev

                            • r
                            • images

                            Android notification triage

                            Source: KoheiTakada/QuietFlow ↗

                            An Android app that can use Jev to sort notifications into five classes, from action required to hide, alongside local safety rules and corrections it learns from you. It starts in observation mode and never cancels notifications there; Jev is opt-in with your own key.

                            KoheiTakada · ★ 0 · MIT · Jev

                            • android
                            • notifications

                            West Philippine Sea Watch

                            Source: gianviterbo/wps-watch ↗

                            A public monitor of the West Philippine Sea with live ship positions, Sentinel-1 radar passes and Global Fishing Watch events. Jev answers four questions about each item from 13 news feeds, and two of them, whether it serves a Philippine reader and whether it carries PRC state framing, decide whether it is shown or held back. Live at wps.gdgt.link.

                            gianviterbo (Gadget Pilipinas) · ★ 0 · Proprietary (contact Gadget Pilipinas for reuse) · Jev

                            • news
                            • maps
                            • monitoring

                            Tetris Arena

                            Source: arndth/tetrisarena ↗

                            Jev, SAP-RPT-1, LLMs and a 15-line heuristic play Tetris on the same pieces and candidate moves, with live cost tracking. In the maker's 50-piece race Jev and the heuristic both cleared 19 lines and the others 18, a tie within noise; the difference was speed and cost.

                            arndth · ★ 0 · MIT · Jev

                            • game
                            • comparison

                            Decision models as tool routers, measured

                            Source: Daewooki/decision-agent-lab ↗

                            Calls Jev, OpenAI's Decisions API, Upstage Solar Decide and local Ollama models through one interface and logs version, latency, tokens and cost. On picking the right one of 12 tools for 40 Korean and English requests, the maker measured Jev 1.13 at 40 of 40 and OpenAI Decisions at 0.90, against 0.85 for a generative model choosing directly.

                            Daewooki · ★ 0 · MIT · Jev, Decisions API, Solar Decide, Nimble

                            • agent
                            • benchmark

                            Terms of service checker

                            Source: shohei81/jev-tos-checker ↗

                            A Chrome extension that splits the terms of service on the page into clauses and has Jev check each for eight kinds of one-sided term, from selling your data to forced arbitration, marking only clauses that go well beyond what major services do and showing each next to the original text. The maker says it is not legal advice.

                            shohei81 · ★ 0 · MIT · Jev

                            • browser
                            • extension
                            • legal

                            CI failure triage

                            Source: tejred213/ci-triage ↗

                            Jev reads each failed test and decides the cause: environment or timeout, flaky assertion, genuine regression or API contract mismatch. Code re-runs the build only when every failure would be fixed by re-running (three attempts in all by default), gives flaky tests a low-priority ticket as well, and files tickets for real failures with the test's owner.

                            tejred213 · ★ 0 · no licence · Jev

                            • ci
                            • devops

                            Which fixes clear most Intune noncompliance

                            Source: dallascrilley/intune-why ↗

                            Reads Intune compliance data from Microsoft Graph, groups failing devices by the setting that fails, and ranks fixes by how many devices each makes fully compliant. For custom settings its rules don't cover, Jev can optionally pick the remediation path. You can try a live demo with a sample tenant.

                            dallascrilley · ★ 0 · MIT · Jev

                            • it admin
                            • microsoft

                            Classified ads filter

                            Source: Aladincz/Jev-Content-Filter ↗

                            A browser extension that asks Jev about every ad on the Bazoš classifieds site against criteria you write in plain language, and collapses the ones that don't match. Other marketplaces and auction sites are planned.

                            Aladincz · ★ 0 · MIT · Jev

                            • browser
                            • extension
                            • shopping

                            Agent questions answered by Jev

                            Source: jflowers/opencode-auto-question ↗

                            An opencode plugin for autonomous runs: when the agent stops to ask the human a question, Jev (or an LLM, if you set one; the default tries Jev first) picks from the offered options. Below a configurable confidence (0.6 by default) it gathers context in a side session and decides again; below 0.35 the human answers after all.

                            jflowers · ★ 0 · Apache-2.0 · Jev

                            • agent
                            • coding

                            Drex inside DuckDB and other SQL systems

                            Source: nace-ai/drex-duckdb ↗

                            Nace's DuckDB extension asks typed questions about rows from SQL and returns probabilities as column values, for routing support tickets, classifying documents or scoring data you already query. Nace also publishes MIT-licensed connectors for Snowflake, PostgreSQL, ClickHouse and Apache Spark, including Databricks SQL. Text and JSON calls default to drex-v2.0; images need an image-capable model such as drex-max.

                            Nace AI · ★ 0 · MIT · Drex 2.0, Drex Max

                            • sql
                            • database

                            Source: Snowflake → Source: PostgreSQL → Source: ClickHouse → Source: Apache Spark and Databricks SQL →

                            Cameo: put yourself in any video

                            Source: kristopolous/comfyui-cameo ↗

                            A ComfyUI workflow that adds you to an existing video. Liquid's d1-2B judges every shot (framing, whether there's room for one more person, where everyone stands) and casts the best ones, then image and video models put you in beside the people already there.

                            kristopolous · ★ 0 · MIT · d1

                            • video
                            • comfyui

                            Kariyer decision bench: Turkish job ads

                            Source: kubrakrcn/kariyer-decision-bench ↗

                            Written at Kariyer.net R&D to pull seniority, department and work type out of job ads. On 600 real ads with 7 questions each (4,200 decisions), Jev 1.13.0 scored 71.5% against 64.6% for the open tau-4b and 65.7% for a prompted 4B LLM. tau-4b was better calibrated (ECE 0.093 against 0.156), and it scored 95.7% on its own training data, which is why the author warns against benchmarking a model on the set it shipped with.

                            kubrakrcn · ★ 0 · Apache-2.0 · Jev, tau-4b

                            • benchmark
                            • turkish

                            Narrative audit: earnings calls against the numbers

                            Source: adityavsb/narrative-audit-jev ↗

                            A harness that checks claims from earnings-call transcripts and footnotes against tables in DuckDB, on 64 synthetic cases. Perplexity's pplx-decider-flash-v1.2 scored 85.94% at about 1.4 s a case; a rule baseline scored 68.75% but caught only 2 of 9 Q&A deflections, which the decider caught 9 of 9. A chat model led on accuracy at 90.62%, with confidences stacked at 0.99 to 1.00. OpenRouter's chat endpoint rejected the decider with HTTP 400, so it runs through the separate /api/alpha/decisions endpoint.

                            adityavsb · ★ 0 · MIT · Decider

                            • benchmark
                            • finance

                            layagrep: train Laya to search code

                            Source: gak4u/layagrep ↗

                            jevgrep finds code by asking Jev thousands of yes/no questions. layagrep records those questions on SWE-bench tasks and fine-tunes the open Laya to answer them locally, with no API key and no code leaving the machine. A smoke run on 400 held-out questions lifted file-navigation AUC from 0.79 to 0.94 (Jev 0.97), but declaration relevance stayed at 0.58 (Jev 1.00).

                            gak4u · ★ 0 · Apache-2.0 · Laya, Jev

                            • code-search
                            • fine-tuning

                            decision-cli: local LLMs as decision models on a Mac

                            Source: cafe3310/decision-cli ↗

                            Reads the probabilities of the answer tokens from one forward pass of an ordinary local LLM, with no fine-tuning, and serves them through a CLI, batch mode and a Jev-like API on Apple Silicon. On the 231 public JevBench questions, gemma-4-26b-a4b scored 84.8% at about 170 ms a question and ling-3.0-tiny 69.7% at about 45 ms; most of the misses are on the hard set.

                            cafe3310 · ★ 0 · Apache-2.0 · Local MLX models

                            • cli
                            • mlx
                            • local

                            Decision model kernels: a faster llama.cpp on one GPU

                            Source: WyrmKeep/decision-model-kernels ↗

                            A lab notebook for speeding up one decision model, H2O Lightning 4B, served through llama.cpp on an RTX 3060 Ti. Each request takes 2.13 to 2.45 times its roofline floor. The first measured change, a llama.cpp pull request, cut latency by 1.94% with bit-for-bit identical answers; the bigger gains in its list of 15 targets are labelled predictions.

                            WyrmKeep · ★ 0 · MIT · H2O-Lightning-4B

                            • inference
                            • llama.cpp
                            • cuda

                            JEV Damocles: when a group-chat bot should speak

                            Source: ch7flyer/astrbot_plugin_jev_damocles ↗

                            An AstrBot plugin that decides whether a bot in a group chat should reply. It merges bursts of messages, separates conversation threads, then asks Jev four questions, batched into one request when the backend supports it (was the bot addressed, does it follow, should it reply, how urgent). For messages without a direct mention, quote-reply or poke, it uses a high and a low reply threshold alongside other checks, and scores in between can be reassessed later; those direct interactions can skip the gate. The README suggests a 3 to 7 day dry run first.

                            ch7flyer · ★ 0 · MIT · Jev

                            • chat
                            • bot
                            • astrbot

                            JevRouter: Jev picks the next step, a policy decides

                            Source: HangChi/JevRouter ↗

                            An agent runtime where an LLM reads the task, one Jev call answers four typed questions (next action, risk, whether to confirm, whether to reason further) and a local policy engine decides what may run. On 53 versioned test cases it hit the expected action 92.5% of the time against 96.2% for an LLM baseline, at about 1.0 s against 4.0 s, and asked for confirmation on 16 of the 17 cases that needed it.

                            HangChi · ★ 0 · MIT · Jev

                            • agent
                            • runtime
                            • policy

                            skill-tester: grading agent skills with Jev

                            Source: milesroxas/skill-tester ↗

                            An eval harness for agent skills: headless agent runs, code checks, Jev judge packs and blind human review; the generic pack asks one yes/no question per skill rule. Graded with the writing pack, the reference skill's v2 run matched its original benchmark's report within 2 points on every layer and in total.

                            milesroxas · ★ 0 · MIT · Jev

                            • evals
                            • agent-skills

                            dsh-cu-d1: Liquid's d1-2B drives a browser and a Mac

                            Source: Alyosha28/dsh-cu-d1 ↗

                            Uses Liquid's open d1-2B as a local System 1 for DeepSeek Harness Browser Use and macOS Computer Use, with approvals and routing. Downscaling wide screenshots before the model reads them cut one decision from 879 ms to 310 ms on a 2508-pixel window, and six consecutive trials all chose a click action. d1-2B itself is under the LFM Open License, not MIT.

                            Alyosha28 · ★ 0 · MIT · d1

                            • computer-use
                            • browser
                            • local

                            Agastya: walking a document's outline to find answers

                            Source: cars3/agastya ↗

                            Retrieval that walks a document's table of contents, asking Jev one yes/no question per section, then ranks the sections it kept with EmbeddingGemma. On all 6,005 test queries of the public SearchTome release it returned 89.1% of gold sections at 3.6 sections per query, against 84.5% at 3 for EmbeddingGemma alone; its top-1 and top-3 recall equal the embedding model's. Jev alone, ranking flat, scored 54.2 top-1. It needs no training and runs on one 8GB consumer GPU, and failed upgrades are published too.

                            cars3 · ★ 0 · MIT · Jev

                            • retrieval
                            • search

                            Jev picks the move for a robot arm

                            Source: uhiron55/physical-ai-2026-advanced-1-final-assignment ↗

                            A course project where Jev chooses the transfer strategy for a CRANE+ arm in a Gazebo simulation, MoveIt 2 plans the path and ROS 2 controllers run it. In three episodes on authenticated Jev decisions with no fallback, Jev picked the home transfer at 0.94 to 0.96 confidence and all three placed the cube, 2.70 to 7.48 mm off target. These are scripted-teacher episodes; the README's separate learned-policy (ACT) tests are not reported as grasp success.

                            uhiron55 · ★ 0 · Apache-2.0 · Jev

                            • robotics
                            • ros2

                            jev-droid: Android automation with two models

                            Source: frederico-kluser/jev-droid ↗

                            Drives an Android emulator from plain language: DeepSeek V4.1 Flash decides the next step, and Jev triages each screen (loading, error, permission prompt) and guards actions before they run. The three-step demo in the README, Settings to Network to Wi-Fi, cost $0.00019 and took 21 seconds; every step saves its screen, decision, tokens and cost.

                            frederico-kluser · ★ 0 · MIT · Jev

                            • android
                            • agent

                            topic-gate: reset the chat when the topic changes

                            Source: tauseefau/topic-gate ↗

                            Asks Jev one question per message, 300 to 600 input tokens, to tell whether the conversation is on the same topic, a subtopic or a new one, and recommends a session reset only when a new topic wins clearly (p of at least 0.65 and 0.25 ahead), so you stop paying to resend a dead transcript. Checked against live Jev on related, unrelated and short messages.

                            tauseefau · ★ 0 · MIT · Jev

                            • context
                            • agent

                            Laya Notes: notes that tag themselves

                            Source: itsdula/laya-notes ↗

                            A desktop notes app for Mac, Windows and Linux that keeps plain Markdown files and runs the open Laya model on your own computer. Each tag is a yes/no question, like "Is this note about a trip?"; Laya answers all of them for a note in one pass and keeps the tags it is confident about. Notes stay on the computer; the only network request is a one-time download of about 1.6 GB of model files.

                            itsdula · ★ 0 · MIT · Laya

                            • notes
                            • desktop
                            • local

                            pi-omarchy-cu: Linux desktop control for the Pi agent

                            Source: Paul-Yuchao-Dong/pi-omarchy-cu ↗

                            Lets the Pi coding agent drive real Linux desktop apps on Omarchy (Hyprland Wayland) by reading the accessibility tree and asking Jev for the target element and the operation. It offers 11 Wayland-safe element operations. Jev-driven actions abstain below 0.55 confidence and need confirmation below 0.70, or 0.90 for destructive ones; direct operations on a known element run without Jev.

                            Paul-Yuchao-Dong · ★ 0 · MIT · Jev

                            • computer-use
                            • linux
                            • agent

                            Decision Wall: 200 questions about one text

                            Source: charles-forsyth/jev-decision-wall ↗

                            Asks Jev 200 yes/no questions about one text in a single call and shows the answers as a heatmap. The keyless hosted demo replays recorded answers. VENDOR-REPORTED: about 185 ms for one question, 200 ms for 50, and 150 to 300 ms for 200; seven parallel calls returned 1,400 answers in 282 ms, against 1,092 ms back to back. The author measured Jev 1.14 from a US home connection and has not measured calibration.

                            charles-forsyth · ★ 0 · MIT · Jev

                            • classification
                            • heatmap

                            Jev-Router: choose a model after applying hard constraints

                            Source: AIAnytime/Jev-Router ↗

                            An OpenAI-compatible router that filters models by hard constraints before Jev judges which one fits. VENDOR-REPORTED, on its own 30 prompts: tier accuracy was 100% against 53.3% for a heuristic, task-type accuracy 83.3% against 46.7%, and hard prompts sent to a weak model 0 against 14. Estimated savings against always using the strongest model, from token counts and configured prices rather than running the chosen models, were 35.6% against 68.7%; the heuristic's estimate was higher because it under-routed. Decision latency was 295 ms at p50 and 409 ms at p95.

                            AIAnytime · ★ 0 · MIT · Jev

                            • routing
                            • agent

                            Laya and ZCode: local checks and context selection

                            Source: Ydjin1984/laya-zcode-stack ↗

                            Runs multilingual Laya through a local Go/ONNX service, with a ZCode plugin for risk checks, context selection and 13 MCP tools. VENDOR-REPORTED on an RTX 3060, three runs per variant: total input fell from 359,085 to 239,544 tokens (33.3%) and requests from 16 to 9, but non-cached input rose 21.8%. Laya ranking alone cut total input 9.3% and non-cached input about 2.8%, within the observed range; the author has not established a fresh-token or cost saving. The /decide endpoint took about 26 ms at p50.

                            Ydjin1984 · ★ 0 · MIT · Laya

                            • coding
                            • context
                            • local

                            Source: Benchmark and caveats →

                            PR wall: separate judgments about each pull request

                            Source: House-elves/pr-wall ↗

                            Puts open pull requests on a wall and asks Jev eight typed questions about each diff and its tests, using quarkusio/quarkus by default. It keeps the answers separate and never combines them into a score. Right/Wrong feedback records corrections and groups accuracy by confidence as you label answers; no accuracy figures are published yet. Its questions and Quarkus context are adapted from brunobat/quarkus-pr-wall.

                            House-elves · ★ 0 · Apache-2.0 · Jev

                            • code-review
                            • calibration

                            openclaw-d1-local: local decisions for OpenClaw

                            Source: heff0/Kev-claw-decisionmaking ↗

                            Supplies OpenClaw with local typed decisions from LiquidAI/d1-Omni-2B-MLX-8bit on Apple Silicon. It has a native decision provider and a bridge for OpenClaw's TypeSafe integration. The repository name contains Kev, but the runner loads d1-Omni. VENDOR-REPORTED on an M4 Mac mini: about 200 ms per warm batch and about 3 GB of resident RAM.

                            heff0 · ★ 0 · MIT · d1

                            • agent
                            • local
                            • apple-silicon

                            inspect-drex: score agent outputs against a rubric

                            Source: nace-ai/inspect-drex ↗

                            A scorer for the UK AI Security Institute's Inspect framework that asks Drex whether an output meets your criteria and keeps the probabilities, so you can change pass thresholds after the run. It defaults to drex-max, whose target changes with flagship releases; pin a model for repeatable runs. Drex Max accepts images, while drex-v2.0 accepts text and JSON.

                            nace-ai · ★ 0 · MIT · Drex 2.0, Drex Max

                            • evaluation
                            • agent

                            OwnYourTimeline: filter the X Home feed

                            Source: raghavio/ownyourtimeline ↗

                            Filters the For you and Following feeds in Chrome or Edge using a plain-language instruction and Jev. It sends one bulk TypeSafe request per timeline response, splitting to stay within input budgets, and removes posts scoring at least 0.90 before X renders them. Errors and timeouts leave posts visible; it checks at most 80 posts per response. The built extension has Chromium tests with X and TypeSafe responses stubbed. No filtering-accuracy figures are published.

                            Raghav Sharma · ★ 0 · MIT · Jev

                            • feed-filtering
                            • browser-extension

                            Jev router for GitHub Copilot

                            Source: TechPreacher/jev-router-copilot ↗

                            Jev sizes a Copilot message as tiny, everyday, large or hardest and sends it to a helper agent pinned to a model. Defaults are Haiku 5.5, Sonnet 5.5 and Opus 5.5, with the hardest helper configured to request high effort. Recorded helper runs used medium effort. The author records live runs of the hook in Copilot CLI 1.0.105 and VS Code 1.144, plus the CLI wrapper. The MCP fallback is tested offline only. Its 54 offline tests passed when checked on 03 Nov 2026; it publishes no savings benchmark.

                            Sascha Corti (TechPreacher) · ★ 0 · MIT · Jev

                            • model-routing
                            • coding-assistant

                            Source: Live CLI wrapper run → Source: Live VS Code run →

                            clef-playa

                            Source: wevans997-dev/clef-playa ↗

                            Clef scores tiles from Jamen Percy's 2026 Burning Man gigapan, then the code sums expected RV counts, car counts and shade coverage. The author's 256 px run judged 8,785 tiles for $5.29, estimating 14,385 RVs, 18,084 cars and 256.8 acres of shade. These are estimates: vehicles under shade are hidden, and dense 512 px tiles undercount. Splitting validation tiles into 256 px quadrants brought RV estimates to 386 against 394 from the LLM counters.

                            wevans997-dev · ★ 0 · MIT · Clef

                            • aerial-imagery
                            • counting

                            Author's recorded runs · VENDOR-REPORTED

                            dsh-system-one

                            Source: Xunzhuo/dsh-system-one-plugin ↗

                            A DeepSeek Harness plugin uses vLLM-SR d3-ultra to triage steps, guard tool calls, strip injected lines and check whether work is done. This is the model maker's integration, by Xunzhuo Liu, co-founder of vLLM Semantic Router. In his small probes, the guard got 35 of 36 commands right, stopping all 16 risky ones, and the shield got 22 of 22 passages right. He reports a 0.49 s median across 53 guard decisions. Triage of 230 tickets took 121 s and 117,877 LLM prompt tokens, against 543 s and at least 510,986 for the LLM alone.

                            Xunzhuo Liu · ★ 0 · Apache-2.0 · vLLM-SR d3-ultra

                            • agent-guardrails
                            • coding-assistant

                            Author's recorded runs · VENDOR-REPORTED

                            Source: Maker profile → Source: Maker's website →

                            mail-agent

                            Source: Jaydccq/mail-agent ↗

                            Incoming Gmail goes through Jev triage before alerts reach Telegram or Lark. Claude or Codex CLI can draft replies, which wait for a Send tap. One Python process uses one SQLite file. The author's testing notes record real Jev calls on nine synthetic emails at about 0.1 s each, plus an end-to-end run with real Gmail, Telegram, Jev and Codex CLI; they report no triage accuracy figure.

                            Jaydccq · ★ 0 · Apache-2.0 · Jev

                            • email-triage
                            • notifications

                            Author's recorded runs · VENDOR-REPORTED

                            Source: Testing notes →

                            Sluice

                            Source: Potterluo/sluice ↗

                            A coding harness lets a worker propose state transitions and a judge approve, reject or redirect them. Its 02 Nov 2026 real-model run used Jev 1.14 as judge and deepseek-v4-pro as worker. The author reports five judge calls for under $0.0003; the allowed-choice menu corrected three requests for nonexistent states. A separate five-task SWE-bench pilot does not identify its judge, so its score cannot be attributed to Jev.

                            Potterluo · ★ 0 · MIT · Jev

                            • coding-assistant
                            • agent-controller

                            Author's recorded runs · VENDOR-REPORTED

                            Drone Commander, Powered by Jev

                            Source: Ramolisdenneyous/Drone-Commander-Powered-by-Jev ↗

                            In this local field test, Jev picks a unit's action from legal option IDs supplied by a tactics game's rules engine. The server checks the choice; a deterministic fallback handles late, malformed or weak replies. The author estimates about 75% lower token cost for those decisions with no obvious loss of tactical ability. Those are early playtest impressions. The first matches set both confidence and margin gates to zero, letting every legal Jev choice play.

                            Ramolisdenneyous · ★ 0 · MIT · Jev

                            • games
                            • tactics

                            Author's recorded runs · VENDOR-REPORTED

                            Chinese game-comment analysis

                            Source: WanKun824/pbz-comment-insight ↗

                            A local laya-multilingual fine-tune labels 9,696 Bilibili comments about Phantom Blade Zero with 14 questions and a two-level topic tree. The author reports 60.8 minutes of training on an RTX 3060. On 771 test comments with 1,485 decisions, topic accuracy rises from 0.210 to 0.911 and validity from 0.253 to 0.971. Test labels come from rules, whose topic precision is estimated at 72% to 75%, so 0.911 measures agreement with the rules. The README also discloses some train/test overlap. Toxicity detection fails at macro-F1 0.489, with only 11 training positives.

                            WanKun824 · ★ 0 · Apache-2.0 · Laya

                            • comments
                            • classification

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Apache-2.0 licence →

                            GitHub issue labels and priorities

                            Source: elcann7/jev-issue-triage ↗

                            A GitHub Action asks Jev nine questions per issue in one request, then a decision table turns the probabilities into labels and priority tiers. Probabilities between 0.3 and 0.7 count as unsure. It has a dry-run mode. The author's run passes 65 of 66 checks on 16 synthetic issues for about $0.001. That small synthetic set includes a fixture revised after its fake-example wording affected the answer.

                            Elcan Səfərli · ★ 0 · MIT · Jev

                            • issues
                            • automation

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: MIT licence →

                            Prompt feedback while typing

                            Source: filip-a-9/jev-prompt ↗

                            This Claude Code mod asks Jev through OpenRouter to grade the prompt being typed and name what it lacks. Hints are advisory; zero-data-retention routing is on by default. On 84 prompts, the band agrees with labels 71% of the time against an 80% target. Across 217 prompts with known outcomes, hints appeared on 25; 24% of those were followed by trouble (95% interval 11% to 43%), against a 10% overall rate. AUC is 0.60. Three blind Claude labellers supplied the labels. The harness is private, and whether the hints improve prompts has not been shown.

                            filip-a-9 · ★ 0 · MIT · Jev

                            • coding
                            • prompts

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: MIT licence →

                            glassbox decision-model checks

                            Source: code2saurabh/glassbox ↗

                            Scans three Laya checkpoints for answers that ignore the state, option-order changes and negation failures. In the author's 04 Nov scan, 5 of 984 instructions collapse on English Laya, 5 on typed-decisions and 35 on multilingual. On a 216-answer realistic guardrail panel, 16, 6 and 42 answers respectively are wrong at confidence of at least 0.9. The panel uses six texts per word, and some scan questions are semantically odd. Results identify cases to check, rather than an overall model ranking.

                            code2saurabh · ★ 0 · Apache-2.0 · Laya

                            • evaluation
                            • calibration

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Scan results → Source: Apache-2.0 licence →

                            Laya in the browser

                            Source: realizer-1966/layaForWeb ↗

                            Runs Laya locally in a browser through ONNX Runtime Web, using WASM on CPU by default. The author reports 97.9% top-answer agreement with PyTorch across 48 questions for each quantized build. In Chromium, the default q8e8 build matches 11 of 12 top answers. A separate synthetic 108-case test of the original PyTorch model gets 59.3% of 312 answers right; that measures model behaviour, not browser parity. Quantized confidence values are approximate because calibration used the full-precision model.

                            YongSoo Park · ★ 0 · Apache-2.0 · Laya

                            • browser
                            • local

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Synthetic test and limits → Source: Apache-2.0 licence →

                            pgdocket stored decisions for Postgres

                            Source: ElyasEbrahim/pgdocket ↗

                            Stores versioned decisions in Postgres and checks calibration against the user's labels. The author's Phase 0 run used Jev 1.13 on 2,000 consumer complaints for about $0.30. Top answers changed on 4.8% of rows across three identical runs, and on about 16.5% when the same rows were rebatched. The repository includes measured Phase 1 ledger and routing runs but has no published release. Its claims about managed hosts have not been tested on Supabase, Neon or RDS themselves.

                            ElyasEbrahim · ★ 0 · Apache-2.0 · Jev / Laya

                            • database
                            • calibration

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Phase 0 findings → Source: Apache-2.0 licence →

                            Low Gate lunar-lander benchmark

                            Source: ErenTerakye/lowgate ↗

                            Decision models choose one of 35 tilt-and-throttle manoeuvres on the same seeded lunar-lander courses. The game waits for the answer, so measured latency never changes the flight score. Across 160 levels per lane, the author reports 159 landings for a scripted autopilot, 156 for Jev, 151 for Kev-27B and 142 for the Laya fine-tune. Prompt selection and Laya training are documented; these results cover this simulator, with recordings available for replay.

                            Eren Terakye · ★ 0 · MIT · Jev, Kev, Laya, Clef-flash

                            • games
                            • evaluation

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Recorded benchmark → Source: Prompts and training → Source: Licence →

                            Glimmer visual inspection

                            Source: aryan-sentlyx/glimmer-system-one ↗

                            Visual-inspection demo and benchmark for Muse Glimmer 30B with logistic decision heads. The maker reports 90.2% defect accuracy on 866 held-out images from known MVTec AD products. Half of each product's test images trained the head. Code, prediction records and a separate zero-shot path are public; the dataset is restricted to research use. The 21 ms early-exit measurement uses a truncated benchmark, while the supplied server runs full depth.

                            Aryan Srivastava · ★ 0 · Apache-2.0 · Glimmer System One

                            • vision
                            • evaluation

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Benchmark report → Source: Runtime and benchmarks → Source: Licence →

                            Weight edits and code patches for Laya

                            Source: demirelo/weight-edit-lab ↗

                            Tests whether LLM-written weight edits or Python overrides repair Laya's routing of Banking77 messages into five departments. In a two-seed pilot, the best code-patch mean is 78.1% accuracy, against 76.9% for the best weight-edit mean at a different effort setting and 70.3% unedited. Test-selected fine-tuning reaches 75.0%. Budgets differ beyond label counts, and isolation relies on paths and log scans. Stored logs and summaries support the reported runs; saved edited weights are omitted.

                            demirelo · ★ 0 · MIT · Laya

                            • evaluation
                            • routing

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Laya results → Source: Licence →

                            Jarvis voice commands for Mac

                            Source: craigraphics/jarvis ↗

                            Handles exact voice commands with patterns, then asks Jev to choose an action for natural phrasing; an LLM handles uncertain cases and writes text. The author reports 69 measured commands: patterns handle 54%, and Jev the other 46% at 116 ms median. All eight questions and comments return unknown and run nothing. Its automated tests use no network or real sign-ins.

                            William Craig · ★ 0 · MIT · Jev

                            • voice
                            • automation

                            Authors' published runs · VENDOR-REPORTED; not independently reproduced

                            Source: Decision routing → Source: Licence →

                            Reply Router

                            Source: fm4238704/reply-router ↗

                            Rules handle unsubscribe and automatic replies first; local Laya labels the rest, with uncertain messages sent to an LLM. The author reports 110 of 117 selected replies correct at a 0.80 threshold out of 182 real replies. Rules were written after reading that same set, and model-drafted labels remain under review. Fresh held-out performance is unknown.

                            fm4238704 · ★ 0 · MIT · Laya

                            • local

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            Contract-review judge test

                            Source: james-tn/decision-model-contract-judge-eval ↗

                            Tests Microsoft-Decision-1 and a frontier reasoning model as contract-review judges on 2,091 ContractNLI and 1,224 CUAD judgments. Decision-1 with rules scores 82.9% and 90.0% accuracy. It reads overlapping chunks while the frontier model reads whole documents; added rules and confidence definitions differ. This is one author’s field test.

                            james-tn · ★ 0 · MIT · Microsoft-Decision-1

                            • evaluation

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            Korean Laya workflows

                            Source: realizer-1966/laya-workflows-ko ↗

                            A Korean adaptation of layaForWorkflows, using the multilingual Laya checkpoint in the browser. It records model answers for 37 examples across seven workflows. At branch threshold 0.50, its replay routes 15 automatically, 17 to people and five to blocking. Wording was adjusted against these examples, so this is a demonstration set.

                            realizer-1966 · ★ 0 · Apache-2.0 · Laya

                            • local

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            Korean Laya RAG judge

                            Source: realizer-1966/laya-rag-judge-ko ↗

                            Runs multilingual Laya and a multilingual MiniLM embedder in the browser on Korean fictional documents. Its Korean report gives 62.5% accuracy on 72 claims with the default two-option question and 28% final-outcome agreement on 32 routing questions. The retained English README describes upstream results, not these Korean runs.

                            realizer-1966 · ★ 0 · Apache-2.0 · Laya

                            • local

                            Published author-run records, checked 5 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            Jev in Tern’s browser

                            Source: cyriusweng/jev-tern ↗

                            A browser agent in Tern’s visible WebKit tab: Jev 1.14 judges steps and GLM-5.3-Flash supplies typed values. The author records nine successful runs across three Wikipedia tasks. Median times are 1.6, 3.4 and 1.8 seconds. The same tasks shaped several fixes; the browser-use comparison uses a different browser and model, so it does not isolate the decision model’s speed.

                            cyriusweng · ★ 0 · MIT · Jev

                            • evaluation

                            Published author-run records, checked 6 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published run →

                            Korean Laya memory checks

                            Source: realizer-1966/layaForMemory-ko ↗

                            A Korean browser adaptation of Laya Memory, using multilingual Laya and MiniLM to flag stale stored facts. On 62 hand-written cases, the author records 19.4% strict accuracy and 27.4% lenient accuracy with the default policy; it closes one of 22 stale facts and wrongly invalidates one standing fact. This sample also shaped the questions and thresholds. App-event pairs have not been recorded.

                            realizer-1966 · ★ 0 · Apache-2.0 · Laya

                            • evaluation

                            Published author-run records, checked 6 Nov 2026; not reproduced in this scan.

                            Source: Licence file → Source: Integration code → Source: Published Korean run → Source: Recorded answers →

                            Laya browser grounding

                            Source: Who-Code/laya-browser-grounding ↗

                            A browser element picker tested on an M2 Pro with 16 GB RAM. The author records 94 correct element picks from 94 live-site decisions across five runs, while only 91 of 95 browser steps finish. Page and action failures explain the difference. The wider grounding comparison finds no significant accuracy difference after multiple-comparison correction. Raw runs and a demo are public.

                            Who-Code · ★ 0 · MIT · Laya MLX

                            • developer tool

                            Author-run records and source checked 7 Nov 2026; not rerun locally.

                            Source: Licence file → Source: Grounding and browser code → Source: Recorded live run → Source: Results and limits →

                            typestrict CPU runtime

                            Source: typestrict-lab/runtime ↗

                            A Rust and ONNX HTTP server for typestrict decision models, with no model bundled in its image. A pinned TS-PRGuard download script checks file hashes; golden vectors record the browser reader’s real model outputs. HTTP tests check answer shapes and errors. The author’s Apple M5 strategy measurements compare latency, memory and throughput, not model accuracy.

                            typestrict-lab · ★ 0 · Apache-2.0 · TS-PRGuard

                            • developer tool

                            Author-run records and source checked 7 Nov 2026; not rerun locally.

                            Source: Licence file → Source: HTTP implementation → Source: Pinned test-model download → Source: Recorded model outputs → Source: HTTP contract checks →

                            Shakedown game playtesting

                            Source: kkgzsprov/shakedown ↗

                            A game playtest pipeline with planning between runs, model tactic selection and a code executor. Its recorded 36-run campaign made 247 Jev decisions, with 17 random fallbacks. All runs were valid, but the rule player had better outcomes: it escaped in all six aggressive runs while Jev’s aggressive player did not move. Three seeds and 12-second runs make this an exploratory demo.

                            kkgzsprov · ★ 0 · Apache-2.0 · Jev

                            • developer tool

                            Author-run records and source checked 7 Nov 2026; not rerun locally.

                            Source: Licence file → Source: Recorded campaign → Source: Replay-verified demo →

                            Smart Factory AI Operations Center

                            Source: Imperfective/smart-factory-ai-ops-center ↗

                            A simulated factory gives Jev a menu of feasible actions and puts an independent safety gate before the virtual PLC. Stored real-model campaigns cover 1,260 shifts and 32,226 calls without API errors or fallbacks. Most plan-completion gain comes from the surrounding architecture; its deterministic planner matches the full system at lower operating loss. No real equipment is controlled.

                            • 1,260recorded real-Jev simulation shifts

                            Minkyu Kim · ★ 0 · MIT (code, documentation and simulation results); CC BY-NC-SA 4.0 (vision results) · Jev

                            • simulation
                            • control

                            Author-run simulation records, not a fresh reproduction. Confirmatory batches exclude mock runs and the standalone extra shift. The gain from adding Jev alone is not statistically significant.

                            Source: MIT licence → Source: Licence notice → Source: Jev client → Source: Stored runs →

                            Laya in JavaScript

                            Source: johnhenry/laya-js ↗

                            Runs Laya through native MLX, WebGPU or a TypeScript CPU reference. The author records 756 of 756 matching top answers against Python across three checkpoints and four GPU configurations. This measures implementation agreement on 63 questions, without labelled task accuracy. Q4 changes one to five top answers per checkpoint on those questions.

                            • 756/756top answers matching Python across GPU configurations

                            John Henry · ★ 0 · MIT · Laya MLX

                            • runtime
                            • local

                            Author-run parity and performance records on a fanless Apple M2. Matching top answers does not mean identical probabilities; sustained thermal throttling changes timing.

                            Source: MIT licence → Source: Agent code → Source: Parity and timing records → Source: Recorded Python outputs →

                            Medical answer-choice research

                            Source: JuneYaooo/medical-jev-train ↗

                            Training, inference and evaluation code for the medical-jev-4b adapter. The published GPU package check records 1,028 correct answers out of 1,514, with 100 over-limit questions counted wrong. Experimental tournament handling produces a different result, 1,050 correct.

                            JuneYao · ★ 0 · MIT · medical-jev-4b

                            • medical education
                            • fine-tuning

                            Author-run records, not a fresh reproduction. The benchmark was reused during development; the original training file is lost and the public training pool is reconstructed. The model is uncalibrated and is not for clinical use or triage.

                            Source: GitHub → Source: Licence → Source: Inference code → Source: GPU package check → Source: Evaluation and limits →

                            Kanana on DGX Spark

                            Source: yangs1202/Kanana-2-v-decide-3b-2611-dgx-sparks ↗

                            Pinned BF16 Docker recipe for Kanana on one NVIDIA GB10. Published memory, HTTP latency and Korean-exam records include actual choice, noul and score responses. The maker measured up to 17.12 GiB additional unified system memory under standalone load. A final image rebuild did not repeat full GPU loading; earlier loader runs and live-server smoke results remain separate.

                            yangs1202 · ★ 0 · MIT recipe; Kanana Open License weights and NVIDIA image terms · Kanana-2-v-decide

                            • local
                            • runtime
                            • benchmark

                            Source: Recipe licence → Source: Validation and scope → Source: Real three-type API response →

                            Hunch judgment tests

                            Source: oneryalcin/hunch ↗

                            Versioned judgment specs with cached answers, human review, tests and a diff of decisions changed by a prompt edit. The bundled Jev command-guard result covers 38 commands and keeps a warning for a missed outside-project effect. Only its destruction question has gold labels; two other hazards do not. This is a catch-up project discovered through an in-window push.

                            Mehmet Öner Yalçın · ★ 0 · Apache-2.0; server directory Elastic License 2.0 · Jev

                            • evaluation
                            • guardrails
                            • data

                            Author-run output; not independently reproduced

                            Source: Code licence → Source: Server licence → Source: Jev integration → Source: Recorded test output →

                            WorkflowEvals calibration audit

                            Source: Mohith26/jev-calibration-audit ↗

                            Recomputes calibration and selective agreement from pinned, published WorkflowEvals outputs for nine models across four workflows. The saved results reproduce 36 headline scores. Its reference is a two-LLM probability consensus, not human truth; no fresh model is called. Case-level gates remain in-sample.

                            Mohith Gajjela · ★ 0 · MIT · Jev

                            • evaluation
                            • data

                            Author-run records; no fresh model inference reproduced

                            Source: Licence → Source: Results → Source: Dataset matching → Source: Metric implementation →

                            Multilingual sentiment benchmark

                            Source: uran-lajci/system-one-multilingual-sentiment ↗

                            Three-label sentiment code and saved predictions for Jev, Clef and Clef-flash on eight European languages. The zero-shot report covers 12,970 test items. Its comparison with five LLMs uses published paper scores with a different prompt format, rather than fresh matched calls. Broader prepared datasets and tuning runs are separate from this reported scope.

                            Uran Lajci · ★ 0 · CC0-1.0 · Jev, Clef

                            • evaluation
                            • classification

                            Author-run records; no fresh model inference reproduced

                            Source: Licence → Source: Zero-shot report → Source: Saved score table → Source: Jev English predictions → Source: Inference code →

                            Nopescope browser filter

                            Source: WLojek/nopescope ↗

                            A Chrome extension with local Basal topic judgments, word and author rules, and MobileCLIP image matching. Its report records browser-model parity and end-to-end fixture and live-page checks on an M4 Pro. Text evaluations use synthetic English and Polish posts; image scene matching does not reliably identify people. Downloaded weights keep their own licences.

                            WLojek · ★ 0 · Apache-2.0 · Basal

                            • filtering
                            • browser

                            Author-run records; no fresh model inference reproduced

                            Source: Licence → Source: Run report → Source: Browser inference →

                            Strands Decider 2B hobson-v19 on SageMaker

                            Source: logesh4v/kiro-crew-decider-sagemaker ↗

                            Deploys Strands Decider 2B hobson-v19 to a SageMaker real-time endpoint and connects it to Kiro Crew. The pinned manifest matches hobson-v19 provenance, including the adapter and head hashes. The maker reports 35 benchmark invocations with no errors on ml.m5.2xlarge in Mumbai: warm median 2,894 ms and p99 3,031 ms. These deployment measurements belong to hobson-v19, separate from the v1 three-run weight average. The default 1,000 ms client timeout needs raising. The endpoint was removed after the run. Source includes the serving shim, invocation check, benchmark and cleanup; this does not establish Bedrock availability.

                            S Logesh · ★ 0 · MIT · Strands Decider 2B hobson-v19

                            • decision-model

                            Source: Licence → Source: Serving shim → Source: Pinned weight manifest → Source: hobson-v19 checkpoint provenance →

                            Blabla Meter

                            Source: maths-oliveira/blabla-meter ↗

                            A Chromium extension that scores pages and sections with Jev, while a generative model writes summaries on demand. Its usefulnews component publishes a 24-article Jev/LLM comparison and preference-feedback examples from September; those records do not benchmark the current extension.

                            maths-oliveira · ★ 0 · MIT · Jev

                            • reading
                            • browser

                            Maker's recorded runs · VENDOR-REPORTED; not independently reproduced

                            Source: Recorded Jev run → Source: Licence →

                            phishbench

                            Source: nwang783/phishbench ↗

                            Tests OpenAI Decisions API on reduced web-page text, with plain-HTML and headless-browser views. The published rendered-page summary records 60/68 reviewed phishing pages detected at threshold 0.5 and 2/198 benign pages flagged. Review labels came from an AI assistant, and raw pages and per-site predictions are not public.

                            Nathan Wang · ★ 0 · MIT · Decisions API

                            • phishing
                            • evaluation

                            Maker's recorded runs · VENDOR-REPORTED; not independently reproduced

                            Source: Saved aggregate results → Source: Licence →

                            lazycontroller

                            Source: nicolasambin/lazycontroller ↗

                            An OpenAI-client wrapper that sends closed structured questions to a decision model and falls back on low confidence or unsupported requests. Its saved notebook shows Jev/GPT routing and a local Kev/Ollama path. Shadow mode measures agreement with the slower model; that agreement is not ground-truth accuracy.

                            Nicola Sambin · ★ 0 · Apache-2.0 · Jev / Kev

                            • routing
                            • structured-output

                            Maker's recorded runs · VENDOR-REPORTED; not independently reproduced

                            Source: Executed notebook → Source: Licence →

                            Laya MCP server

                            Source: ferronicardoso/mcp-laya ↗

                            Local CPU inference through laya-ts and ONNX, exposed as MCP tools for typed text questions. The maker records a thank-you note changing urgency when options are reordered. Optional stability checks re-ask the question and flag flips; their scores are uncalibrated, and stable answers can still be wrong.

                            ferronicardoso · ★ 0 · MIT · Laya

                            • local
                            • MCP

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Model integration → Source: Real-model test path →

                            Hybrid Shorts Generator

                            Source: Khelendrameena/hybrid-shorts-generator ↗

                            Selects transcript windows with text-only Laya-multilingual and deterministic features, then asks Ollama for titles and metadata. The maker records real Hindi/English Laya calls and a synthetic end-to-end render. Hook questions disagree on one clip. Live target-machine Whisper GPU and Ollama stages remain untested in that record.

                            Khelendrameena · ★ 0 · MIT · Laya

                            • video
                            • local

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Recorded execution and limits → Source: Laya integration →

                            Callscore call review

                            Source: epifaneia/callscore ↗

                            Reviews call transcripts through closed-option Jev questions, with code measuring interruptions, copying evidence turns and calculating quality scores. The saved SQLite database records 120 artificial calls through OpenRouter. A simulated engine is the default; uncertain critical judgments go to review. These calls do not establish performance on real customers.

                            epifaneia · ★ 0 · Apache-2.0 · Jev

                            • audio
                            • review

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Jev adapter → Source: Saved call database → Source: Published report →

                            Policy Pal guardrail comparison

                            Source: lightshadow1/policy-pal-guardrails ↗

                            Compares frozen regex rules, Jev and GLiNER on four labels. The published reports record model calls and threshold tuning on a random split of a mixed-source question pool. The two “weeks” are not later production traffic; the higher round-2b result is post hoc. The score cache is not committed.

                            lightshadow1 · ★ 0 · MIT · Jev

                            • evals
                            • guardrails

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Run report → Source: Threshold and hybrid limits → Source: Model client →

                            FastABC rubric review

                            Source: GrntKim/FastABC ↗

                            Jev checks individual rubric cells, Gemini reviews uncertain cells, and graders confirm scores. Published raw calls cover 24 synthetic answers and 150 labelled cells. Ten cells go to human review; evidence lookup is billed separately. The small comparison does not establish an accuracy gain.

                            GrntKim · ★ 0 · MIT · Jev

                            • education
                            • review

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Recorded evaluation → Source: Jev adapter →

                            ProbeLoop stated-limit reader

                            Source: subnetMusk/probeloop ↗

                            Uses a fine-tuned Laya ONNX classifier to find explicit knowledge or experience limits in Italian practice answers. A recorded synthetic HTTP/WebSocket turn uses the actual classifier and scripted LLMs. Interview decisions and evaluation remain separate; real-speech quality and physical Mac performance are still open.

                            subnetMusk · ★ 0 · Apache-2.0 · ProbeLoop Laya stated limits

                            • local
                            • interviews

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Pilot and integration run → Source: Current acceptance limits →

                            d1 on Raspberry Pi 4

                            Source: DarvinX/d1-pi4-asm ↗

                            ARM64 assembly inference for d1-2B Q4_K_M and its Q8_0 projector on a 4 GB Pi 4B. Source, manifests and 80 answers are public. Choice questions update 48 selected image positions; direct counts keep all 300. Same-input timing uses four Pi pairs per format; the complete reference accuracy run uses x86 llama.cpp.

                            DarvinX · ★ 0 · MIT code; Liquid model and CV-Bench terms separate · d1

                            • local
                            • vision

                            Author-run records; not independently reproduced

                            Source: Licence → Source: Benchmark protocol and results → Source: Third-party terms → Source: Image-question helper →

                            Snapcall training and serving

                            Source: AIAnytime/snapcall ↗

                            A CLI and dashboard for preparing labelled examples, training decision heads, evaluating predictions and serving a System One endpoint. Its released Laya medical-document classifier includes a separate held-out test report. The toolkit’s RLCD recipe is its own implementation; it does not disclose TypeSafe’s training code.

                            AI Anytime · ★ 0 · Apache-2.0; model and dataset terms separate · Laya

                            • training
                            • evaluation

                            Public trained weights and evaluation record; no fresh training run

                            Source: Licence → Source: Released model and report → Source: Held-out evaluation →

                            Evidence

                            What independent research has found so far

                            Papers, leaderboards, head-to-head tests, a security test and a hands-on review, then a small test we ran ourselves.

                            Benchmark · VENDOR-REPORTED

                            The phishbench maker reports 60/68 reviewed phishing pages detected and 2/198 benign pages flagged by OpenAI Decisions API at threshold 0.5, using headless-rendered text from the reported URL. Feed labels alone give 77/126 detections. An AI assistant reviewed the labels; popular benign sites are an easy comparison group. Only aggregate scores are published, so the raw labels and predictions cannot be independently checked.

                            Nathan Wang · phishbench · 9 Nov 2026Source ↗
                            Field report · VENDOR-REPORTED

                            Trustle's Jev IAM experiment found that showing only a role's 25 riskiest permissions pushed 84% of assignments to the highest risk level. It changed the input to include typical permissions and the overall access mix, and kept escalation/secrets as minimum levels in code. A later fit on 110 public Google Cloud roles raised held-out weighted agreement with its reference from 0.75 to 0.86. The article supplies no public raw predictions; this is an internal evaluation, not proof of safe access control.

                            Adam Guymon · Trustle · 30 Oct 2026; found through 10 Nov HNSource ↗
                            Maker benchmark · VENDOR-REPORTED

                            Javier Marín reports ZeroPoint 53.6% and Strands Decider 2B v1 58.6% correct decisions across 900 matched cases, half without a correct option. Both arms use the same 0.9 confidence threshold. Confident wrong picks on no-answer cases are 7.8% and 0.0%. Among each model's correct decisions, including correct none decisions, 66.0% for ZeroPoint and 36.8% for Strands reach that threshold. The maker supplies saved outputs. CPU/GPU timings use different hardware, and ZeroPoint canonicalizes option order before scoring.

                            Javier Marín · ZeroPoint saved comparison · checked 10 Nov 2026Source ↗
                            Independent reanalysis · saved outputs

                            Mohith Gajjela’s reanalysis of published WorkflowEvals outputs reports Jev ECE 0.029 on 11,110 categorical questions and 0.030 on the 10,954 questions all nine models answered. The reference is the mean of two LLMs’ probabilities, so these measure consensus agreement. Score questions are excluded from calibration tables; whole-case gates are in-sample. No fresh models were called.

                            Mohith Gajjela · WorkflowEvals calibration audit · 8 Nov 2026Source ↗
                            Independent benchmark · sentiment

                            The author reports zero-shot three-label sentiment macro-F1 of 61.7 for Jev, 54.1 for Clef and 48.5 for Clef-flash, averaged equally across eight European languages and 12,970 items. English Jev is 68.0. Five LLM comparisons come from Kastrati et al. (2026), with different prompt formats rather than newly matched calls. The saved predictions and score table are public.

                            Uran Lajci · zero-shot conference report · run 6 Nov 2026, discovered 9 NovSource ↗
                            Independent benchmark · Decision Index v2

                            Artificial Analysis’s Decision Index v2 combines six evaluations and includes calibration in its Decision Score. AA-Paperclip carries 30% of the index and treats all 15 answers about a document as one decision; it uses 1,500 private documents. AA-Symmetry carries 15% and tests answer and probability consistency. The new tasks and scoring prevent direct comparison with v1 scores, JevBench or the Hugging Face index.

                            Artificial Analysis · Decision Index v2 · launch 8 Nov 2026 23:51 UTCSource ↗
                            Author-run evaluation · command guard

                            Hunch's stored Jev-1.13.0 test reports 0.9737 accuracy on destruction labels for 38 shell commands. Its 0.90 act rule accepts 22 of those judgments with no recorded errors. The other two hazard questions have no gold labels, and a pinned warning records a missed outside-project effect when stopping every bun process. This small bundled sample does not establish a production safety rate.

                            Mehmet Öner Yalçın · Hunch bundled test output · catch-up discovery 9 Nov 2026Source ↗
                            Maker evaluation · answer support

                            The d1-2B RAG Verifier maker reports F1 81.5 and AUROC 0.936 on 2,700 RAGTruth responses, against base F1 70.9. Checkpoint and threshold were chosen on document-grouped development data. The fine-tune runs BF16 while the base comparison uses Q8_0 llama.cpp, so this is not a precision-matched training ablation. The reported 69% coverage at 95% accuracy is a test-set confidence curve, not a threshold guarantee for new answers. The source responses date to 2023; base-training overlap is unknown.

                            landtml · RAGTruth test predictions and model card · 8 Nov 2026Source ↗
                            Maker evaluation · missing facts

                            JevAlt and its Intern-Decision base both choose unknown in 9 of 11 held-out missing-fact cases. Fine-tuning raises the mean unknown probability from 0.55 to 0.74 in that small test, without improving the choice count. Deem-4B records 122/130 correct in a separate 4 Oct live check, including 10/10 missing-fact cases and 10/10 fact-present controls. The held-out decisions share the training-data pipeline.

                            Mert Kaya · Deem-4B card and recorded requests · October 2026, catch-up discovery 8 NovSource ↗
                            Author-run study · unified memory

                            One DGX Spark recipe records up to 17.12 GiB additional system memory for Kanana under standalone HTTP load, measured from the fall in MemAvailable. It retains 16.07 GiB after 30 seconds idle. Synthetic-image timings measure serving load, not vision accuracy; the single-request short-text mean is 0.038 seconds. Concurrent GLM tests use a particular 524,288-token setup and do not establish universal coexistence or a hardware minimum.

                            yangs1202 · Kanana DGX Spark raw runs and reports · 8 Nov 2026Source ↗
                            Author-run study · coding-agent cost

                            Jevgrep reports 25.8% lower estimated combined task cost, $5.6564 against $7.6221, with 8/10 solves in both conditions. A later ten-task candidate cuts Jev cost about 59% but raises combined cost 2% to 3% against that saved cohort, with the same solve count. These are repeatedly studied Python tasks, one attempt per condition and reused baselines. Failed attempts count. Native costs use list prices; 19 later empty responses leave some usage unknown, bounded by the report rather than counted free. No general cost or speed gain follows.

                            David Zhang · Jevgrep total-cost records · 28 Sep 2026, catch-up discovery 8 NovSource ↗
                            Maker evaluation · Minecraft fine-tune

                            The Laya Minecraft maker reports accuracy moving from 0.9301 to 0.9325 and ECE from 0.0625 to 0.0435 on 415 decision items. Four overlap training or calibration. The agent filters valid actions before asking the model and verifies progress afterwards. These figures measure decision items, with no strictly held-out end-to-end gameplay result.

                            Thomas Tesche · Laya Minecraft card and training report · 7 Nov 2026Source ↗
                            Maker evaluation · medical text

                            medgemma-decide-4b-v2 reports medline/adverse balanced accuracy rising from 0.625 to 0.825 after minority-class oversampling, above its 0.721 TF-IDF floor. Macro balanced accuracy across sources falls from 0.689 to 0.686; PubMedQA falls from 0.578 to 0.488 under the prior-adjusted decision rule. The maker evaluates 19,480 decisions in 15,320 records, one seed per run. These public text-label and exam tasks are not clinical validation; the model is research only.

                            Amaljith · medgemma-decide-4b-v2 card and results · 7 Nov 2026Source ↗
                            Practitioner evaluation · identity resolution

                            Hightouch reports 98.8% accuracy at $0.88 per 1,000 synthetic identity checks when Jev sends 22% to Opus, against 99.0% and $3.86 for Opus alone. On its harder set, the cascade scores 95.3% at $2.94, versus 95.1% and $5.39 for Opus alone. The first set has 1,000 identities with half deliberately over-merged; thresholds were explored on that test. The article supplies neither uncertainty intervals nor a numeric calibration comparison. Its results do not establish production error rates on rare over-merges.

                            Albert Jin, Neil Desai and Delaney Mackenzie · Hightouch · 4 Nov 2026, shared on HN 6 NovSource ↗
                            Author-run simulation · Jev and rules

                            Across 210 simulated disruption scenarios at two load levels (420 pairs), the factory controller reports plan-completion gain 0.114 for the full system over ML detection plus fixed rules. Adding Jev alone gives 0.002, with a 95% interval from -0.021 to 0.031. Most gain comes from validation and safety controls; the deterministic planner matches the full system at lower operating loss. The stored confirmatory batches contain 1,260 real-Jev shifts and 32,226 calls. These results concern virtual equipment, not a deployed factory.

                            Minkyu Kim · Smart Factory AI Operations Center · public research release 7 Nov 2026Source ↗
                            Maker evaluation · synthetic tracks

                            RASD Laya's maker reports accuracy 0.956 and macro-F1 0.903 on 23,358 test rows from held-out simulation runs. Training uses the same simulator and fixed text format. The rules baseline abstains as unknown when evidence is thin, which lowers its accuracy under this scoring. Unknown-class precision for the fine-tune is 0.571. No real-sensor validation is reported.

                            Galal Ban Amr · RASD Laya model card · 7 Nov 2026Source ↗
                            Browser grounding study

                            In the author’s Laya-MLX browser study, correct element picks reached 94 of 94 recorded live decisions, but only 91 of 95 browser steps completed. On a separate 144-case comparison, no grounder’s accuracy difference survived multiple-comparison correction. The tested pages and candidate lists constrain transfer to other sites.

                            Who-Code / Keller · recorded browser study · 6 Nov 2026Source ↗
                            Maker evaluation · spam labels

                            The maker reports 95.4% agreement with Jev on 978 held-out Telegram messages at a 0.81 deletion gate, precision 0.82 and recall 0.70. The newest 15% is held out by time. This tests imitation of Jev labels; it supplies no independent human judgment of spam. The model does not inspect media contents.

                            Nikita Kolmogorov · Laya Telegram spam card · 6 Nov 2026Source ↗
                            Maker study · label wording

                            Ru-Jev’s author holds routing questions fixed and tests ten vocabularies with five candidates and eight with eighteen. The augmented release gains up to 0.24 accuracy on ordinary and borrowed words; abbreviations gain nothing useful, and opaque codes remain near chance on the strict slice. Eleven of fourteen gains survive Holm correction. With eighteen candidates, confident errors rise on jargon and slang. Each recipe has one training run; other data changes prevent attributing all differences to augmentation.

                            Beskorovainyi · arXiv 2611.08439 · 5 Nov 2026Source ↗
                            Retrieval security · arXiv

                            In a 1,000-query test of forum-style pages with hidden instructions, attack pages are retrieved for 986 queries. The authors report automatically measured attack success of 27.9% with the baseline guard prompt, 13.6% with combined mitigations and 5.7% with Kev added. It wrongly flags 4 of 186 benign instructional pages. A separate 200-query pollution experiment needs filtering before top-ten selection; filtering only those ten leaves too little evidence. The synthetic attacks and tested pipelines limit transfer to deployed systems.

                            Ghadamyari and Habibi · arXiv 2611.08325 · 5 Nov 2026Source ↗
                            Field test · browser memory

                            On 62 hand-written Korean memory/event cases, multilingual Laya’s default policy scores 19.4% strict and 27.4% lenient accuracy. It closes one of 22 stale facts and wrongly invalidates one standing fact. The event gate labels 39 of 62 inputs as commands and another 13 as questions or plans, bypassing most pair checks. Questions and thresholds were developed on this sample; the English upstream results use a different checkpoint and runtime.

                            realizer-1966 · Korean Laya Memory recorded run · 5 Nov 2026Source ↗
                            Field test · browser agent

                            The author records nine successful Jev-tern runs across three Wikipedia tasks, with median wall times of 1.6, 3.4 and 1.8 seconds. Browser-use also succeeds nine times, using Chromium and GLM-5.3; Jev-tern uses WebKit, Jev 1.14 and GLM-5.3-Flash. The tasks prompted several fixes, including code that jumps to a uniquely named heading, so the reported speed gap combines models, browsers and task-specific code.

                            cyriusweng · Jev-tern benchmark and raw rows · 5 Nov 2026Source ↗
                            Multi-agent plan test · arXiv

                            TandemBench supplies global information and candidate team plans for 1,200 cooking-coordination questions, with references established through execution and exact search. The authors compare 40 native decision models with 10 general-purpose LLMs. The best native decision model reaches 62.50% plan-selection accuracy, while optimality verification remains near chance. Some models report better alternatives whether or not an optimal plan is already among the options. This tests plan selection and verification, not a live multi-agent deployment.

                            Li, Feng and Qin · arXiv 2611.05827 · 4 Nov 2026Source ↗
                            European-language study · author-reported

                            Zuse’s author reports 87.5% accuracy for its 27B model across 27 languages, with pooled ECE 0.016 and source-weighted ECE 0.035. This is a development suite that also guided model selection, with one seed. Calibration gaps vary by task; a shared temperature cannot fix both overconfidence on knowledge questions and underconfidence on acceptability. English public-suite results trail Jev and Kev. The paper’s claim that no prior models reported outside English is not adopted here.

                            Umair Mehmood Imam · arXiv 2611.06238 · 4 Nov 2026Source ↗
                            Presentation audit · arXiv

                            Across 9,000 humor, helpfulness and summarization items, the authors collect 702,000 judgments from Jev, Clef Flash and Perplexity Decider while changing presentation but preserving the evaluated texts. Jev’s second-position probability advantage reaches 6.11 percentage points on summaries. Reversing reader endorsements changes Decider’s selected humor text on 40.40% of pairs. These are separate interventions and tasks; repeatability, presentation robustness and agreement with people are different checks.

                            Agrawal and Mamidi · arXiv 2611.06384 · 4 Nov 2026Source ↗
                            Production classifier · VENDOR-REPORTED

                            Airbnb reports a Gemma4-E2B fine-tune reaching max F1 0.902 from 0.563 on a 10,000-example weighted production-policy set, at 35 ms median gateway latency. Its public-model serving uses one RTX Pro 6000. Scores use the best threshold for models returning probabilities, while generative APIs supply one verdict. The cost comparison uses October list rates and an assumed 71% cache hit rate; the roughly 1% cost result depends on high request volume. This is Airbnb’s task and infrastructure, not a universal hosting break-even.

                            Gibson and Elmalaha · Airbnb Engineering · checked 5 Nov 2026Source ↗
                            Local Laya text labels · author-run

                            LUAR tests Laya on 300 texts per dataset on a Windows laptop with integrated graphics and 16 GB RAM. The author reports 93% English AG News accuracy; Portuguese B2W review results are 70% recommendation, 68% sentiment and 33% exact star rating. With confidence at least 0.7, topic accuracy is 98% on 84% of news rows, versus 72% to 75% on selected review rows. Review labels are customer ratings and may not match the written text.

                            HayateV30 · LUAR recorded evaluation · 4 Nov 2026Source ↗
                            Korean RAG pilot · author-run

                            In a browser run on 72 claims about 18 fictional Korean documents, multilingual Laya scores 62.5% accuracy and 0.62 AUROC with two options; yes/no scores 65.3% and 0.67. Three options lower the false-verification rate from 36.1% to 11.1%, while accuracy falls to 58.3%. Its separate 32-question router reaches only 28% final-outcome agreement. These are a small demo’s recorded runs, not a general Korean-language benchmark.

                            YongSoo Park · Korean Laya RAG report · 5 Nov 2026Source ↗
                            Contract judging · independent

                            On 2,091 ContractNLI judgments, the author reports Microsoft-Decision-1 with legal rules at 82.9% accuracy versus 79.1% for medium-reasoning gpt-6-astra without rules. On 1,224 CUAD judgments the figures are 90.0% and 88.0%. Decision-1 chunks documents; the frontier reads whole contracts and supplies verbal confidence. A 0.90 cascade escalates 30% of ContractNLI judgments but touches every document, so judgment coverage is not document-call savings. This is one run, not a universal model ranking.

                            james-tn · contract-review judge field test · Nov 2026Source ↗
                            Repeated-call test · independent

                            On 2,000 consumer complaints, pgdocket's author repeated the same Jev 1.13 requests three times with identical options and batches. Probabilities match on 27.5% of rows; 95.2% keep the same top answer across all three, so 4.8% change. Rebatching the same rows changes about 16.5% of top answers. These are one author's dated API observations, not a measurement of every decision model or current Jev release.

                            ElyasEbrahim · pgdocket Phase 0 · 17 to 19 Oct 2026Source ↗
                            Simulator benchmark · independent

                            Low Gate flies 20 seeded courses of eight levels per lane. Its author reports 156 of 160 landings for Jev, 151 for Kev-27B, 142 for a Laya fine-tune and 159 for the scripted autopilot. All lanes choose from 35 manoeuvres, and the game waits for every response. It measures this simulator's landing rate; response time cannot reduce a lane's score. Prompts and Laya training were selected separately from the scored courses.

                            Eren Terakye · Low Gate recorded benchmark · checked 5 Nov 2026Source ↗
                            Author-run experiment · GitHub

                            A two-seed Banking77 routing pilot reports Laya accuracy of 70.3% unedited, 78.1% with Opus 5.5 high-effort code patches, 76.9% with medium-effort weight edits and 75.0% for test-selected fine-tuning. Code patches have the highest mean in this pilot, while individual runs overlap. Editors get correction sentences and may embed extra messages or add architecture; budgets are matched only by labels. Some logs omit tool transcripts, leaving leakage unresolved for those runs.

                            demirelo · weight-edit-lab Laya pilot · 4 Nov 2026Source ↗
                            Vendor evaluation · visual inspection

                            Glimmer System One's maker reports AUROC 0.962 and 90.2% accuracy on 866 MVTec AD images held out from the same 15 products used for head training. Its layer-13 head reports 0.954 and 88.3%. The zero-shot path reports AUROC 0.882 with temperature fitted by leaving products out. The trained-head and zero-shot tests use different splits. VENDOR-REPORTED; not independently reproduced.

                            Aryan Srivastava · Glimmer System One heads card · 4 Nov 2026Source ↗
                            Author-run scan · GitHub

                            A 04 Nov glassbox scan asks 984 yes/no instructions of each of three Laya checkpoints. It flags 5 English, 5 typed-decisions and 35 multilingual instructions as high-confidence answers that ignore the state and stay flat on a varied text panel. Changing option order changes 26 of 96 English choice answers. The author separates cue-insensitive answers from collapse after an early scanner over-counted them. Some probe questions are semantically odd; the realistic panel has only six texts per word.

                            code2saurabh · glassbox 0.1.0 · 4 Nov 2026Source ↗
                            Adversarial study · arXiv

                            On AG News, low confidence ranks hijacked answers above clean ones on four of five systems at AUROC 0.86 to 0.90. At a threshold fitted to alarm on at most 5% of separate clean calibration articles, the three API-served systems still miss 51% to 70% of plain-note hijacks. Adding one handwritten sentence that asks for certainty raises misses to 99% to 100%. Ranking attacks and stopping them at a usable false-alarm rate are different tests.

                            Yao et al. · Ranked but Not Stopped · arXiv 2611.02522 · 2 Nov 2026Source ↗
                            Study · arXiv

                            Nine model sizes from 0.8B to 32B are fine-tuned with one LoRA recipe across general decision and finance data. Narrow training costs 9 to 45 percentage points of general decision competence. On realized-return questions, every size stays near the horizon-conditioned prior at 0.37 to 0.38 accuracy under the study's controls. A mixed training corpus restores general decision performance while retaining policy answers and near-specialist calibration. This study finds no conditional return-prediction edge in its tested models.

                            Kumar · Honest Small Decision Models for Finance · arXiv 2611.03755 · 2 Nov 2026Source ↗
                            Adversarial study · arXiv

                            JevBreak tests seven decision models on 240 text examples from 16 tasks, targeting 990 wrong-option outcomes per model. Its probability-guided Slot Attack succeeds on 32% to 99% of tested record and wrong-option pairs whose clean answer was correct, with a median 17 to 72 queries per successful attack. Attackers can force every available wrong option on about 20% of correct JEV decisions, 77% for gpt-6-luna and 98% for GLiNER2.5. Confidence thresholds do not reliably screen out these attacks.

                            Birur et al. · JevBreak · arXiv 2611.03759 · 2 Nov 2026Source ↗
                            Benchmark study · arXiv

                            SLATE tests long sequences of API choices over an e-commerce library of about 1,000 tools. Its simulator grades whether every reference outcome is reached and accepts alternative valid paths. Across six open decision models and their language-model backbones, from 3B to 12B parameters, the best system completes 5.0% of tasks. These results concern whole multi-step tasks, not accuracy on a single tool choice.

                            Wei et al. · SLATE · arXiv 2611.03982 · 2 Nov 2026Source ↗
                            Study · arXiv

                            OLIVIA freezes the analysis before unblinding a January to July 2026 stock-news test. A fine-tuned decision model's daily information coefficient falls from 0.055 and 0.065 on two validation quarters to 0.020 (t=1.7) on the blinded test. Three commercial models track the overnight move but not the return after the open. No pre-registered strategy survives costs and a deflated Sharpe ratio. The commercial models identify masked companies in 62% to 74% of cases, against a 28% baseline, so removing names does not remove identity clues.

                            Dehkordi et al. · Thinking Fast, Trading Late · arXiv 2611.03985 · 2 Nov 2026Source ↗
                            Pilot study · arXiv

                            On 30 fully synthetic clinical cases and 120 typed questions, adding structured memory raises Jev accuracy from 90.0% to 93.3%. Five answers improve and one worsens; exact McNemar p=0.219. Choice log loss falls from 0.258 to 0.175 and binary Brier score from 0.054 to 0.022. Memory adds 310 input tokens per call on average, with mean latency still about 0.5 seconds. Labels are one author's judgments and the memory is an oracle upper bound, not extracted production output. This pilot does not validate clinical use.

                            Sayani, Karwande, Bharadwaj · Structured Clinical Memory · arXiv 2611.04101 · 3 Nov 2026Source ↗
                            Study · arXiv

                            A recruitment audit compares demographic changes in CV scores, rankings and shortlists against run-to-run variation on unchanged CVs. It finds small but measurable demographic effects for Jev, especially through implicit cues such as names. The bias set has 572 English CVs and 11 job descriptions across 11 occupations. Names follow US and UK conventions, with two names per group (four for Asian ethnicity) and binary gender. The controlled CV edits do not measure downstream hiring outcomes or certify fairness.

                            Ul Haq, Rigoni, Sperduti, Fabris · Fast, Cheap, and Fair? · arXiv 2611.04510 · 3 Nov 2026Source ↗
                            Alert paging · authors' numbers · VENDOR-REPORTED

                            Coroot replays 31 synthetic p99-latency scenarios minute by minute, with a three-minute hold before paging. Its burn-rate rule gets 30 of 31 right; Jev 1.13 tuned at 0.59 gets 29; Tev1-4B at 0.5 gets 28; untuned Jev and tuned Nimble 9B get 27. Explaining the hold raises Tev1-4B from 23 to 28. Coroot reports about $30 for two OpenRouter passes, including eight cents for Jev. Thresholds were tuned on these same scenarios, designed to be obvious to a human with a fixed 1 s SLO.

                            Coroot · Anomaly detection for alerting · 03 Nov 2026Source ↗
                            Issue calibration · author's numbers · VENDOR-REPORTED

                            On 2,319 GitHub issues with one human type label each, typesafe-cascade reports 76.7% accuracy for Jev 1.14 with no threshold. At 0.8 it keeps 1,964 issues at 81.9% accuracy; at 0.95 it keeps 1,689 at 85.2%. The 1,794 issues in the 0.9 to 1 confidence bucket average 98.9% confidence but only 84.3% accuracy. Excluding question labels gives 99.1% confidence and 91.7% accuracy in that bucket. The author suspects maintainers' resolved-issue labels add noise and would fix the label set before tuning the threshold. The sample is stratified by label, unlike a real backlog.

                            monumei · typesafe-cascade · Jev 1.14.0 results · 03 Nov 2026Source ↗
                            Weight patch · author's numbers · VENDOR-REPORTED

                            A lowercase positive predicate makes the English Laya root checkpoint answer false at full confidence regardless of the state in code2saurabh's reproduction of issue #1244. Rank-1 edits to layers 16 to 21 use 12,288 learned numbers, a 54 KB patch fitted in about six minutes on a GTX 1650 Ti. On 872 SST-2 validation reviews, accuracy rises from 0.491 to 0.888 and AUROC from 0.496 to 0.940; wrong answers at confidence at least 0.9 fall from 443 to 13. Two held-out wordings score 0.858 and 0.890. The labels workaround still scores higher at 0.908. Only the English root checkpoint was tested; the negative wording stays near 0.62.

                            code2saurabh · Laya #1244 weight patch · English checkpoint 7b928d82, laya 0.4.21 · 03 Nov 2026Source ↗
                            LLM judges · arXiv

                            Across eleven judge benchmarks, Subramanian tests 14 decision models against generative judges. Five are statistically indistinguishable from GPT-5.6 without reasoning across all five pairwise and best-of-4 benchmarks. With a reference answer, eleven reach 90.3% to 93.4% on JudgeBench, statistically indistinguishable from Opus 5.5 and GPT-5.6 with reasoning. Injection reverses 0% to 5% of correct verdicts for five models, but 17% to 49% for the other nine. The figures are Subramanian's measurements.

                            Shreyas Subramanian · To Jev or Not to Jev · arXiv 2611.00505 · 31 Oct 2026Source ↗
                            Languages · arXiv

                            An English winner need not win elsewhere. XDecideBench covers nine suites, 122 languages, 88,425 texts and 153,875 typed questions. The English-best model, chosen in hindsight, loses significantly in 56 of 232 suite-language cells. A confidence threshold fitted on English for 5% errors admits 7.8% to 12.4% on German and French XNLI. These are Šuppa and Kopčan's measurements; thresholds need checking in the language and task where they will run.

                            Marek Šuppa, Jaroslav Kopčan · XDecideBench · arXiv 2611.01370 · 01 Nov 2026Source ↗
                            Policy gates · authors' numbers · VENDOR-REPORTED

                            Examples and counterexamples changed how policy gates behaved in agentapprove's study. James P. Beno tested 22 hosted decision models and two prompted general models on 2,643 synthetic tool calls labelled blind against 28 rules, with a sealed holdout. Explicit boundaries raised recall by 5.5 to 26.1 points on all 23 models still available and reduced false positives on 21. Jev 1.14's recall rose from 89.3% to 98.2%; unnecessary interruptions fell from 30.6% to 4.8% of 252 clean actions. With examples, its median latency was 120 ms at $0.46 per thousand requests. The author sells the policy engine.

                            James P. Beno, agentapprove · Decision Models as Policy Gates for Coding Agents · arXiv 2611.02155 · 01 Nov 2026Source ↗
                            Cognitive tasks · arXiv

                            S1CogBench tests 24 cognitive tasks in 27 modes. Laya fails to beat uniform choice on 17 of 26 targets, against 3 for Intern-Decision-4B, which beats its Qwen3.5 backbone on 23. In Mouselab, Qwen earns the highest autonomous reward but predicts humans worse than uniform choice; Laya fits humans best among the open models yet earns zero reward. Under the same readout, Intern-Decision is no faster than its same-size backbone. Generating text takes 80 to 316 times as long as one forward pass in the two general models timed. Hou and Yamada report these results.

                            Dengzhe Hou, Kazunori D. Yamada · S1CogBench · arXiv 2611.00911 · 31 Oct 2026Source ↗
                            Vulnerability triage · authors' numbers · VENDOR-REPORTED

                            At a fixed review budget, Cyber-JEV misses fewer vulnerable functions in its authors' test. An ensemble of five fine-tuned Qwen3.5-4B models reaches AUROC 0.814 on 7,270 functions, against 0.743 for Jev 1.13. With both limited to 4,031 alerts, it misses 16 of 322 vulnerable functions instead of 39. The method trains on matched vulnerable, patched and unchanged functions; the paper links no code.

                            Zhao et al. · Cyber-JEV · arXiv 2611.02957 · 02 Nov 2026Source ↗
                            Live-web benchmark · vendor's own · VENDOR-REPORTED

                            Parallel's PWS-Decisions averages three runs of 300 questions on 29 Oct 2026 (Pacific). Its API with live web search scored 76.22%; Perplexity Decider v1.2 scored 50.89%, OpenAI's Decisions API 41.67% and Jev 1.14 33.44% without web access or supplied external context. Parallel puts uniform random guessing at 42.42%. GPT-6 Luna and Claude Haiku 5.5 with native search scored 97.33% and 96.56%, at $16.52 and $27.43 to $28.79 per 1,000 questions, against Parallel's $1.00; median latency was 7.42 and 6.38 seconds against 0.56. Parallel generated synthetic questions from its own customer topics and search traffic, with separately researched answers and exact-match scoring; refusals count as wrong. It calls this a development challenge set: 100 questions are gated, 200 private, and questions, answers and per-question predictions cannot be redistributed. The runner is MIT. The blog chart labels Baseten Elephant at 32.4% overall and 32.3% public; the repo instead records Mammoth at 45.0% and 37.0%.

                            Parallel · PWS-Decisions v0.1.0-rc1 · blog, repository results and dataset terms · 01 Nov 2026Source ↗
                            Retrieval routing · independent · author's numbers

                            Adding Clef-Flash 9B as a domain router reduced pooled nDCG@10 from 0.4503 to 0.4084 in nicklisac's retrieval experiment. Per-domain LoRAs with the router reached 0.4923; a joint LoRA without it reached 0.4947. Perfect domain assignment to specialists gave an oracle ceiling of 0.4991. The detailed report and logs use 2,161 held-out queries over FiQA, ArguAna, SciFact and CQADupstack-gaming, with EmbeddingGemma 2 on one RTX 3090; the README says 1,081. Post-retrieval reranking and pruning with Clef-Flash also reduced the corresponding embedding-only scores.

                            nicklisac · lora-router-rag · REPORT.md and results/run_log.jsonl · checked 03 Nov 2026Source ↗
                            Untuned 4B baseline · independent; Together comparison · VENDOR-REPORTED

                            Using Tev1's own decision protocol and v1 evaluation data through local Ollama, jev-rsi's author measured untuned Qwen3.5-4B at 673/1,000 (67.3%) on test and 130/300 (43.3%) on policy_transfer. Together reports 880/1,000 (88.0%) and 300/300 (100%) on evaluation sets used during development (VENDOR-REPORTED). In a separate frozen-backbone experiment with small heads and a fixed self-improvement loop, test scores ranged from 6.7% to 31.1%, against a 29.8% random baseline, on a small held-out set. The author concludes that heads alone did not learn the decision task in this setup.

                            Joshhuang123 · jev-rsi · baseline and frozen-head experiments · 02 Nov 2026Source ↗
                            Earth observation · authors' numbers · VENDOR-REPORTED

                            EO-Jev adapts d3-flash (8.4B, Qwen3.5-9B backbone), from the Decision 1.0 makers, with LoRA for Earth observation. Across 30 settings from 23 public benchmarks, its authors report significant improvements in 26 settings, averaging +23.8 accuracy points in-domain and +8.0 on 12 held-out settings. It matched or exceeded the best open EO specialist in 20 of 28 settings and had lower calibration error in 21 of 28. Median throughput was 6.4x the specialist's with each at its best batch size, or 3.2x with one question per call. General decision accuracy fell 1.8 points. Counting, change quantification and calibration far from the training data remain weak spots. The repository has code and reports; it excludes weights and run logs, and lists the paper as coming soon.

                            Abouelhadid, Abuhani, Munir, Khan, Khan · MBZUAI and collaborators · EO-Jev · 02 Nov 2026Source ↗
                            Defect detection · authors' numbers · VENDOR-REPORTED

                            With two reference images per class across five manufacturing case studies, Jev scored 0.75 to 1.00 test accuracy and Clef-Flash 0.71 to 0.99, against CLIP's 0.67 to 0.84 using the same references. The authors' agentic description refinement improved accuracy in six of eight model/application combinations, and their calibration reduced Brier score in 13 of 15 configurations.

                            Megahed, Chen · Beyond CLIP · arXiv 2610.41199 · 30 Oct 2026Source ↗
                            Visual inspection · authors' numbers · VENDOR-REPORTED

                            VerdictAD uses Clef-Flash 9B to refine existing anomaly detectors with decisions about whole images and local regions. In the authors' four-shot tests, averaged over three reference draws, PatchCore's image AUROC rose from 93.0 to 97.5 on MVTec AD, 89.0 to 93.9 on VisA and 67.4 to 78.0 on MVTec LOCO AD. DINOv2-L rose from 68.7 to 77.5 on LOCO. These are image-level AUROC figures, not accuracy or pixel-level scores; the repository includes the paper and experiment logs.

                            Sun et al. · VerdictAD · code, paper and logs · 02 Nov 2026Source ↗
                            Training case study · authors' numbers · VENDOR-REPORTED

                            One developer trained a decision head and LoRA on Qwen3.5-0.8B with Unsloth to screen job postings. On 63 receipt-labelled test examples, accuracy was 0.762 and macro-F1 0.683, against 0.714 and 0.278 for always rejecting. On a separate 460-posting check against an agent's historical verdicts, accuracy was 0.726, below the 0.835 always-reject baseline. That external check uses a different population and reference. The author's data and trained weights stay private, so a public clone cannot reproduce the scores.

                            jayvir-git · training-own-decisions-model · 02 Nov 2026Source ↗
                            Medical fine-tune · authors' numbers · VENDOR-REPORTED

                            A medical LoRA on Qwen3.5-4B scored 67.90% on 1,514 external questions, against 59.91% for the base with the same scoring method and 70.87% for archived Jev 1.13. The full-set score counts 100 questions with 148 options as wrong because the released interface supports at most 52. On 100 triage questions it answered 40 correctly, against Jev's 66. The maker has not scored 1,620 sealed questions; training labels lack individual clinical-expert review and the probabilities are uncalibrated.

                            JuneYao · medical-jev-4b · model card · 02 Nov 2026Source ↗
                            Pathology · authors' numbers · VENDOR-REPORTED

                            PathoJev encodes a pathology slide once and answers several questions over that shared visual context. Across three whole-slide benchmarks, the authors report mean accuracy of 77.2% for 9B and 78.1% for 27B, exceeding SlideChat by 5.4 and 6.3 percentage points. The 9B model ran 9.1 times faster than SlideChat on WSI-Bench. Against encoding the prefix separately, shared context was 6.9 times faster for eight questions and 11.2 times for 64 at 9B; the 27B figures were 5.9 and 8.9 times.

                            Zhang et al. · PathoJev · arXiv 2610.40752 · 29 Oct 2026Source ↗
                            Search reranking · authors' numbers · VENDOR-REPORTED

                            DecisionRank trains a decision reranker by having a generative teacher judge ranked lists built from the student's scores. The authors report that a 1.7B student beat its 27B generative teacher on TREC DL19 to DL23. At 8B, it beat its generative listwise counterpart while running 24.5 times faster on TREC DL and 16.7 times faster on BRIGHT.

                            Wu et al. · DecisionRank · arXiv 2610.42128 · 30 Oct 2026Source ↗
                            Agent controller · authors' numbers · VENDOR-REPORTED

                            Operon-S1 turns recurring judgments in a biomedical agent into closed questions at 13 decision points. A local decision model answered in-loop requests at a median 0.6 seconds on CPU, with no measurable agent-score change on five of six benchmarks. Asking the driving LLM those same questions instead accounted for 8.0% to 35.2% of task cost. Genoria AI's study spans seven life-science benchmarks overall; the unchanged-score comparison covers six, and task-level results use the public checkpoint.

                            Hou et al., Genoria AI · Operon-S1 · arXiv 2610.41350 · 30 Oct 2026Source ↗
                            Benchmark · independent

                            Liquid's open 2B decision models against two 2B chat models (Qwen3.5-2B, InternVL3.5-2B) on 248 real pictures, all on one RTX 5060 Ti. d1-2B routed scanned documents to one of 16 types at 88.8% against 55% and 56%; d1-Omni-2B classified 71 of 73 clear frames correctly as violent or not (97.3%); on a 50/50 defective-part set the d1 models scored 70.8%. d1 was 1.6 to 23 times faster per question. The author notes it is not quite like for like: the chat models reply in text. On 500 text items d1-2B agreed with Jev's answers 68% of the time.

                            Aditya (@0xironyAditya) · d1-2B vs three 2B models · 01 Nov 2026Source ↗
                            Benchmark · independent

                            Jev as a search reranker against Cohere, Voyage and Qwen rerankers on multilingual MIRACL and Japanese JQaRA. Scoring each passage with its own yes/no question, batched per query, Jev 1.14 scored nDCG@10 0.7496 on MIRACL and 0.8849 on Japanese JQaRA, the best mean of the final seven (0.8173, against 0.8061 for Cohere rerank-4-pro), at $0.89 to $1.14 per 1,000 queries against Cohere's $2.50. In a separate 252-query MIRACL run most dedicated rerankers beat Jev 1.13 by a significant margin; results differ by dataset, model version and scoring method.

                            Jeffrey (Dongkyu) Kim · jev-reranker · 01 Nov 2026Source ↗
                            Game test · independent

                            Decision models playing Super Mario Bros. world 1-1, one choice per step. From the game state, Perplexity's Decider v1.2 cleared the level in 20.13 game seconds for $0.0078, and Liquid's d1-ultra and Inception's Mercury Decide also cleared it. From pixels alone, Decider v1.2 and Baseten's Mammoth 1 cleared it; Jev 1.14's best pixel run reached 51.94% of the level. These are 46 development runs with different settings, which the author says are not a ranking.

                            Nicholas Greenwood · mario-bench · 01 Nov 2026Source ↗
                            Benchmark · independent

                            On the 127 test documents of the Text Anonymization Benchmark (European Court of Human Rights cases), Cloudflare's extraction model Clairic flagged more identities than OpenAI's Privacy Filter but was less precise: 77.7% of its spans were ones annotators marked to hide, against 93.4%. Passing each Clairic span to Jev to decide hide or keep raised precision to 91.1% while keeping Clairic's recall (96% on applicant names and case IDs, where Privacy Filter found 77% and 2.2%). It cost the most: $0.86 per 1,000 judgments against $0.26 and $0.17. Legal documents only.

                            Arjun Kumar, Clavia · Detecting private data using extraction + decision models · 31 Oct 2026Source ↗
                            Benchmark · arXiv

                            13 decision models against 15 generative LLM setups on 1,273 four-option MedQA questions. Decision models scored 67.71% to 89.08%, the generative setups 78.32% to 96.86%. Mercury Decide was cheapest at $0.0069 per 1,000 questions and Clef Omni fastest at a median 0.291 seconds. Answers given a probability of 0.90 or more were still wrong 1.71% to 12.77% of the time, depending on the model.

                            Freyer et al. · Decision models vs generative LLMs on medical questions · arXiv 2610.38448 · 28 Oct 2026Source ↗
                            Bias audit · arXiv

                            Jev and five open decision models on gender-swapped yes/no decisions about people, BBQ and StereoSet. Five of the six gave women significantly more favourable answers than men (+0.05 to +0.10 in log-odds), and swapping gender changed 1 to 3.5% of top answers. The makers' recommended confidence gate removed many biased answers but raised the stereotyped share of those it kept on ambiguous BBQ gender questions.

                            Havinga · When the Top Answer Decides · arXiv 2610.39747 · 29 Oct 2026Source ↗
                            Field report · independent

                            A team put Jev into a multi-agent build pipeline for Claude Code for 16 days, about 5,300 calls, as advisory checks, an on-demand tool and binding gates. It was accurate where the majority answer was enough and mixed elsewhere; 172 of 240 scope judgments came back uncertain or with insufficient evidence. On the claim-support gate, a strong model solved the task from the same excerpt, so the gap was Jev's. They removed it and never measured the token savings they were after. The anonymised data is published, with a script that rechecks 103 of the reported figures.

                            sash-ua · Accurate and Useless · 30 Oct 2026Source ↗
                            Field report · maker

                            Squigdle, a daily drawing game, sends every doodle to Jev as a 512×512 image plus its title and acts on the probabilities with its own thresholds. After about 1,000 doodles the misses are the occasional false alarm, and moderating all of them cost 6 cents in total, about $0.00006 a doodle. These are one developer's figures from a live game.

                            James O'Halloran · Moderating 500 daily anonymous doodles with Jev · 30 Oct 2026Source ↗
                            Field guide · independent

                            Across 20 jobs drawn from TypeSafe's 21 official cookbooks, plus image tests, Jev got 155 of 163 core examples right and 132 of 144 edge cases built to push its known weaknesses. Its main failure: when the right answer isn't an option, it picks the nearest one, often confidently. A replay after the locked tests, adding only a "none of these" exit to the menus, raised correct handling from 11 of 14 requests to 13. 1,463 requests cost $0.0331. Small hand-written samples, not a benchmark.

                            WeBuildDatabases · Jev, job by job · 29 Oct 2026Source ↗
                            Moderation simulation · independent

                            In a simulated moderation queue, a wave of privacy-invading posts arrived that the existing router did not prioritise. Claude drafted one yes/no question in 12 seconds from 20 of those posts and 20 ordinary ones, and a fine-tuned version of the open decision model Laya asked it of every new post. At 100 extra posts an hour, the queue needed one extra moderator instead of three, the same staffing as an oracle rule; the routing threshold was set with labelled calibration data. In a separate test, base Laya answering a fixed money-back question scored AUC 0.68 on consumer complaints, against 0.89 for the complaint's product field. Three seeds; staffing counted in whole moderators.

                            Enayat Hassani · Exposure-aware routing · 29 Oct 2026Source ↗
                            Safety guardrail · USC

                            Put in front of a small LLM (Qwen2.5-1.5B) as an input gate, Jev cut how many of 720 harmful-labelled prompts got an answer from 527 to 17, but refused 27 of 250 safe prompts, against 3 for the LLM alone. A tiered gate that also reviewed borderline answers let 40 through and refused 10 safe ones. Answered counts are a proxy for harm, not checked completions.

                            Cognetti, Krishnamachari (USC) · Jev as an LLM Safety Guardrail · 2026, code and tablesSource ↗
                            Bias audit · independent

                            One identity word moves Jev far more than a name does. On jev-1.13.0, "You are a Republican. Do you want to sign a carbon-tax petition?" got P(yes) 0.15; the Democrat version 0.73. Explicit labels shifted decisions by 3 to 15 percentage points, while Black- vs White-associated names moved them 0.2 (95% CI -0.6 to +1.0). Offering an "equal" option shrank most race, gender, religion and orientation gaps, but large gaps remained for age, undocumented status, class and atheism. 134,772 answers across jev-1.13.0 and 1.14.0, for USD 0.32.

                            Isaac Bitran (Brown University) · Jev bias audit · Oct 2026Source ↗
                            Head-to-head · independent

                            On facts about other companies, Parallel's web-searching Decisions API beat Jev answering from memory: 83 to 98% vs 43 to 70% balanced accuracy on four questions about 50 YC companies. Across that test and a 30-topic publishing test, Jev put 116 of 230 answers between 0.4 and 0.6. On "have we already published this?", handing Jev the 10 closest sitemap URLs took it from 67% to 97%, at about 3% of Parallel's price. One run, one day, small sample.

                            Vedant Bhayani · Jev vs Parallel on two of Eric Siu's Jev gates · 28 Oct 2026Source ↗
                            Hallucination judges · arXiv

                            Five decision models judged 9,852 items for five kinds of hallucination against gpt-6-sol. The best matched it on context inconsistency and came within 3 points on factual errors, but trailed by 4 to 8 on logic and instruction-following. A confidence cascade of decision models matched or beat gpt-6-sol on three types at 1 to 3% of its cost.

                            Liu, Xue, Wang, Mu, Ma, Feng, Li · Decision Models as Judges for Hallucination Detection · arXiv 2610.37229 · 27 Oct 2026Source ↗
                            RAG conflicts · arXiv

                            Asked why retrieved sources disagree, 10 of 11 decision models from 7 providers matched or beat Gemini 2.5 Flash (61.3%), at 4 to 39x lower billed cost (two were free) and 2.6 to 6x lower latency. Gemini 3.8 Flash (70.0%) was more accurate than 8 of them, but sending each model's least confident quarter to it was statistically indistinguishable from Gemini 3.8 Flash for 8 of 11, at 25 to 37% of its cost.

                            Khatri, Jain, Kapoor, Sah · Do We Need an LLM to Know Why Sources Conflict? · arXiv 2610.36915 · 27 Oct 2026Source ↗
                            Vendor comparison · Voyage AI

                            When a collection already has labelled examples, learning from them beat Jev, which labels each document cold. Across 29 classification tasks, Voyage's experimental voyage-json embeddings plus the raw fields, fed to a ridge regression trained on the labelled documents, averaged 88.3 AUROC against Jev's 77.6; Voyage counts that as 48% fewer errors (error = 100 minus the score). Voyage's own test of its own models.

                            Voyage AI blog · How to create your own Jev using Voyage models · 27 Oct 2026Source ↗
                            Option-order test · arXiv

                            Shuffling the order of the answer options across 1,700 questions barely moved Jev's accuracy (under two points), but the set of questions it ever got wrong grew by 27 to 29%, more than plain repetition caused. Across two Jev versions, twelve Jev reproductions and six generative LLMs, Jev showed no general advantage in keeping correct answers.

                            Song, Zheng, Ma, Zhou · Understanding Jev-Style System One Models: Does Structure Reduce Selection Bias? · arXiv 2610.35826 · 26 Oct 2026Source ↗
                            Clinical trials test · arXiv

                            Screening 2,048 patient-condition pairs for clinical trials, with questions batched per patient, Jev matched Qwen Flash (thinking off) on two datasets (macro-F1 0.652 vs 0.660, 0.807 vs 0.814) and beat it on MIMIC-III (0.768 vs 0.534), mostly by flagging when a record lacked the information (56.3% recall vs 9.9%). In batch mode it was faster and an estimated 53 to 74% cheaper per condition; asked one condition at a time, the cost edge did not always hold.

                            He, Gao, Li, Zhang, Wei, Zhang, Yuan · Can JEV Support Clinical Trial Criteria Assessment? · arXiv 2610.35721 · 26 Oct 2026Source ↗
                            Retrieval test · arXiv

                            DecisionRAG uses a decision model to browse a corpus from broad topics down to passages, with no first-stage retriever and no task-specific training. It beat dense retrieval with an 8B reranker by 13.8 R@1 points on MultiDoc2Dial and 17.4 Hit@1 points on Natural Questions, with median query latency of 0.68 to 1.76 seconds across four benchmarks.

                            Wan, Jünger, Du, Liu, Krishnan, Weinberger · Retriever-Free Retrieval: Navigating Documents with Decision Models · arXiv 2610.35868 · 26 Oct 2026Source ↗
                            Reranking test · arXiv

                            Across six Qwen backbones from 0.6B to 27B and ten TREC DL and BEIR collections, decision fine-tuning never made the better reranker. Up to 9B, plain reranker fine-tuning won by 5 to 29 points nDCG@10 and decision fine-tuning added nothing over asking the untuned model; at 27B the two tied. The authors' advice: if you need a reranker, fine-tune a reranker.

                            Dinzinger, Ghosh Dastidar, Granitzer · System One models Are Not Better Rerankers · arXiv 2610.32318 · 23 Oct 2026Source ↗
                            Email routing test · arXiv

                            On an owner-labelled Italian and English inbox (231 emails in the main comparison), logistic regression trained on about 200 labels had the highest accuracy on every field, though statistically tied with Gemma 4 on message type and with hosted Nimble on urgency, ahead of local decision models (Tev1, Nimble). When used to choose actions, it ignored emails that needed action more often than hosted Nimble or Gemma 4 (18% against 4% for the best LLM), until a cost-chosen threshold cut those misses from 12 of 68 to 4 of 68 (18% to 6%).

                            Federico Lucca · Measure Before You Train · arXiv 2610.32955 (v2) · 23 Oct 2026Source ↗
                            Pathology test · arXiv

                            PathJev-P, a decision head on MedGemma-1.5-4B, beat a generative model trained on the same backbone and data, the pathology model CONCH and a general medical decision model on balanced accuracy (0.541 against 0.492, 0.345 and 0.213). Its calibration edge depended on how the generative model's probabilities were read, and a simple linear probe on a pathology foundation model was better calibrated in every setting.

                            Tommasino, Rinaldi · PathJev · arXiv 2610.32478 · 23 Oct 2026Source ↗
                            Search judging · independent

                            Grading 200 held-out Amazon shopping-search results, Jev 1.14 agreed exactly with the human graders 55% of the time, against 43.5% for the best LLM tested (Gemma 3 27B), at a median 118 ms against the LLMs' 435 to 656 ms. Asked to rank eight search setups, Jev ordered 26 of the 28 pairs the way the human labels did.

                            rickcrawford · jev-relevancy, on Amazon's ESCI shopping queries · Oct 2026Source ↗
                            Calibration test · independent

                            Logistic regression with temperature scaling, rebuilt behind Jev's interface, matched Jev's accuracy on a 7-intent banking slice (0.975 each; Jev's calibration error was lower, 0.014 against 0.022, but the gap was within noise) and beat it on all 77 intents (0.888 against 0.859 at best). Jev's choice answers were well calibrated; its yes/no answers were underconfident on true cases.

                            ankur287 · jev-open-calibration, code and data for a Towards Data Science article · Oct 2026Source ↗
                            Language test · arXiv

                            Four decision models on 13 Vietnamese classification settings. With English label descriptions, Jev ranked first by macro-F1 in 11 of them. The weak spot was diacritics: strip the tone and vowel marks and each model's mean macro-F1 fell 9.5 points (Jev, the least) to 15.5 (Quyet), against 0.5 to 1.1 for slang and 2.9 to 4.5 for typos.

                            Ha, Phuc, Quy, Tran · How Well Do Decision Models Transfer to Vietnamese? · arXiv 2610.31422 · 22 Oct 2026Source ↗
                            Legal test · arXiv

                            Swap the correct case holding out of the options and see who admits none fit. Six generative LLMs still picked one in 38-86% of those items; the most cautious of four decision models did so in 30%. On the standard test, a decision model matched the best LLM (88.1% vs 88.2%) at 1/55 of the cost, and accepting the LLM's answer only when a decision model agreed halved its wrong citations.

                            Demir · Commit or Abstain? · arXiv 2610.29961 · 21 Oct 2026Source ↗
                            Clinical judging · arXiv

                            As a judge of 118 paediatric clinical AI answers, Jev's agreement with physicians matched or beat seven of 12 LLM judges, including Claude Opus 5.5 and GPT-6. Frontier judges cost 73 to 294 times more and took 7 to 57 times longer.

                            Gershon, Cohen, Ariel, Bilavsky-Yarden · Decision language models as alternatives to LLM judges · arXiv 2610.28826 · 20 Oct 2026Source ↗
                            Independent index

                            Artificial Analysis launched a Decision Index covering knowledge, reasoning, tool calling and safety classification. At launch Jev 1.13 led the decision models with 58, ahead of GLiDE and Microsoft-Decision-1 on 54. Its sharpest finding: decision models are overconfident.

                            Artificial Analysis Decision Index v1.0 · 13 Oct 2026Source ↗
                            Head-to-head

                            On claim verification Jev ties GPT-6-class models at 0.975, for a fraction of the cost. On Vals AI's LegalBench sample Mercury Decide beats it, 0.869 to 0.740. Given a 1% error budget on claims, Mercury automated 94% at 0.8% error; Jev automated 95% at 1.6%, over budget.

                            Vals AI · Jev evaluation 6 Oct 2026, Mercury Decide evaluation 8 Oct 2026Source ↗
                            Cost trick · arXiv

                            Cut an LLM's reasoning short, then let Jev pick the answer from the half-finished trace. Across 35 reasoner-benchmark pairs, Jev's mean accuracy beat forcing the LLM to answer at every budget tested, from 500 to 16,000 tokens; at 1,500 tokens it added 4.1 points. In offline replay on held-out questions, a tuned stopping policy was estimated to save 71.3% of the full run's cost for a 0.58-point accuracy loss.

                            Wang et al. · Truncated Reasoning Under a Budget · arXiv 2610.25768 · 19 Oct 2026Source ↗
                            Stress test · arXiv

                            The study compared Jev, Tev1-4B and Nimble-9B with two trained classifiers, with class frequencies shifted in simulation; the two open models were also run against their own Qwen backbones. Decision training was not uniformly better: Nimble was better calibrated than its base on intent tasks but scored 12.0 Macro-F1 points lower on financial sentiment. The decision models were not uniquely fragile under shift, though single shifts could still push threshold risk up sharply; their main weakness was miscalibration they already had.

                            Iqbal, Nasim, Saleem · Typed Decision Models under Prevalence Shift · arXiv 2610.26325 · 19 Oct 2026Source ↗
                            Evidence audit · arXiv
                            “In this early literature, the typed readout itself has not shown an independent accuracy advantage over comparable label-probability readouts.”

                            A review of the 28 papers posted in the nine days after Jev launched on 15 Sep 2026. Jev's clearest gains were latency and cost, with accuracy gaps on harder tasks. The authors call it an early evidence map, not a verdict.

                            Typed Decision Models: An Early Evidence Audit · arXiv 2609.32160 · 26 Sep 2026Source ↗
                            Calibration study

                            In SILT's preregistered test of 799 unpublished yes/no questions about coding-agent work and destructive shell commands, Perplexity's open Decider V1.1-27B was the most accurate (94.7%) and the only one of seven models to pass SILT's chosen calibration rule. Jev's result was inconclusive. So were the results for OpenAI's Decisions API and Laya.

                            SILT · Do Decision Models Know When They're Wrong? · 11 Oct 2026Source ↗
                            Security test

                            Used as a prompt-injection detector, Jev caught 82.90% of labelled attacks. Prepend a fake policy inside the untrusted text and it caught 3.88%. The authors separate this classifier bypass from a full agent compromise.

                            Datadog Security Labs · 15 Oct 2026Source ↗
                            Coherence test · arXiv

                            Ask "is it X?" and "is it not X?" and the two probabilities should add to 1. Jev misses by 0.064 on average. Reading the first token of an open 27B model misses by 0.293. Neither is fully coherent.

                            Li, He, Li · Beyond Calibration · arXiv 2609.33209 · 27 Sep 2026Source ↗
                            Independent leaderboard

                            JevBench v1.8.6, published 01 Nov 2026, measures 337 decision models and ranks 217 systems on its open-weights board. Capability averages Intelligence and Calibration within cost and median-latency caps. Mammoth-1 and KnowLine 31B-Gen1 each score 85.2; the board marks their open-weight status Unknown. Jev 1.13.0 is an unranked reference at 77.1. SemIf, formerly OpenJev, is #143 at 55.4 (Intelligence 27.1, Calibration 83.6). Hosted APIs have a separate board.

                            JevBench v1.8.6 · Benchmark Heaven · 01 Nov 2026 · not affiliated with TypeSafeSource ↗
                            First hands-on review

                            Useful for ranking and classification, but it can carry bias you can't see: asked whether Bay Area cities were good, Jev put Cupertino top and East Palo Alto bottom. With only a number coming back, that's harder to spot.

                            Simon Willison · 21 Sep 2026Source ↗
                            Open recipe · arXiv

                            Without any decision fine-tuning, the instruction-tuned Gemma 4 31B already scores 79.6 on the authors' new OpenDecisions set, against Jev's 80.1. The authors' published recipe makes an open Jev possible: after following it, the model scores 84.4 (the authors' own numbers).

                            Geuter, Cheng, Alvarez-Melis · Releasing the Inner Jev · arXiv 2610.17205 · 12 Oct 2026Source ↗
                            Replication · arXiv

                            Political-science coding tasks from published studies, re-run on Jev, GPT-6 Luna and an open Qwen3.8-27B. Jev matched or came close to both, but had no cost edge over OpenAI's batch prices, and its probabilities were better calibrated than Luna's but not consistently better than Qwen's. The authors' verdict: unless you need speed, the main advantage is ease of parsing.

                            Denney, DiGiuseppe · JEV versus LLMs · arXiv 2610.06625 · 6 Oct 2026Source ↗
                            Author-run evaluation · small triage suite

                            A saved local Drex v1.5 Q8_0 run reports 6/10 team choices and 6/10 urgency choices correct, with 10/10 refund checks correct. In the five team answers with confidence 0.9 to 1.0, three are correct. The report contains aggregate scores and bins for an authored demo suite, without per-case raw predictions; it does not establish production calibration.

                            Gjusev · drex-evals · 10 Nov 2026Source ↗
                            Author-run example · conflicting questions

                            The Shorts Generator maker records Laya-multilingual assigning about 0.79 to a strong-hook Noul question on a Hindi clip, while a separate A/B question chooses no hook at about 0.79. The pipeline averages the checks and blends them with deterministic features. One conflicting example does not measure calibration or show that the blend improves clip quality.

                            Khelendrameena · live CPU model notes · 10 Nov 2026Source ↗
                            Author-run comparison · camera stills

                            An AWS Builder Center author reports Strands Decider 2B v1 at 85.2% on camera stills with a 0.25 cutoff chosen on that same set, versus 88.0% for Gemma 4 31B and GPT-6 Luna on Bedrock. Sample size and raw predictions are not supplied. The OpenAI Decisions API row is simulated from a Bedrock run; the filter replays stored answers. L4 throughput and the estimated hosting break-even were not measured.

                            AWS Builder Center · security-camera comparison · discovered 10 Nov 2026Source ↗
                            Benchmark · VENDOR-REPORTED

                            CodeCut reports 807 correct and 1 wrong merge among 808 accepted Abt-Buy product matches, from 1,081 source products; 62 go to review and 211 stay unmatched. Jev chooses among three embedding candidates plus none, merging above 0.7. RapidFuzz and embedding baselines force one match for every product and make 341 and 318 wrong merges. Acceptance policies differ; the article supplies no matched-coverage baseline or committed raw predictions.

                            Khuyen Tran · CodeCut · 11 Nov 2026Source ↗
                            Case study · VENDOR-REPORTED

                            TypeSafe reports shortlist recall of 94.6% for Jev and 93.9% for Gemini 3.1 Flash Lite on 150 live roles, retaining 2,000 from a 6,000-candidate pool. The 0.7-point difference has a 90% interval of -0.4 to +1.8. Reported cost per 1,000 candidates is $0.092 versus $0.755; median time per role is 10.3 versus 20.3 seconds. $500K annual savings is a growth projection; current-volume savings is $265K. This is an offline test, without public raw records.

                            TypeSafe AI / Jack & Jill · 7 Oct 2026Source ↗
                            Case study · VENDOR-REPORTED

                            Amazon reports replacing Sonnet 4.6 with a separate Strands Gemma 4 E4B build for 20 ticket labels plus none. Mean call time is 897 versus 4,215 ms; the approximate $0.0005 versus $0.0222 per ticket uses list prices and instance utilisation, excluding Lambda. Prompts are shortened and old comments dropped to fit 4,096 tokens. Sorted JSON keys follow observed probability shifts up to 0.19. Raw tickets and held-out accuracy totals are not published.

                            Carr Onstott, Mehul Jaiswal and Strands Agents Team · 9 Nov 2026; in-window HN leadSource ↗
                            Benchmark · VENDOR-REPORTED

                            The Policy Pal maker reports four-label accuracy 61.3% for tuned Jev, 48.1% for tuned GLiNER and 26.5% for frozen regex rules on 1,055 test questions. Thresholds use the other 1,036 questions. The two “weeks” are random halves of one mixed-source pool, not successive traffic. The 70.3% Jev result changes rule priority after inspecting test errors and is post hoc. Score caches are not public.

                            William Suriaputra · Policy Pal guardrails · 5 Nov report; 11 Nov repository catch-upSource ↗
                            Benchmark · VENDOR-REPORTED

                            FastABC reports Jev alone at 88.7% and Gemini alone at 90.0% across all 150 labelled cells; the hybrid scores 92.1% on the 140 cells it covers, leaving 10 to a grader. The test contains 24 synthetic answers and 150 labelled cells. The hybrid-minus-LLM 95% interval is -0.7 to +5.1 percentage points. Judgment costs total $0.0534 versus $0.1906; opening every answer for evidence adds $0.0544 to the hybrid. These are maker-labelled examples, with raw calls published.

                            JunMyeong Kim · FastABC · 8 Nov run; 11 Nov catch-upSource ↗
                            Runtime test · VENDOR-REPORTED

                            The assembly-engine maker reports 28.02 s versus 70.19 s median image-choice latency and peak RSS 1,436 versus 1,609 MiB against llama.cpp on a 4 GB Pi 4B. Direct counts take 43.55 versus 70.65 s. Each format uses four same-input Pi pairs with fresh processes and warm filesystem caches, under background load. Assembly starts from decoded RGB; llama.cpp decodes PNG. Full-set reference accuracy uses x86 llama.cpp, whose answers match the eight Pi probes.

                            DarvinX · d1-2B ARM64 engine · 11 Nov 2026Source ↗
                            Benchmark · INDEPENDENT

                            Singularity Feed’s public run compares Gemini Decision 1 with Gemini 3.5 Flash-Lite on the same 2,000 sampled items. Both get 391/500 Banking77 intents right; on CIFAR-10, Decision gets 167/200 and Flash-Lite 170/200. Decision leads the pooled score, 86.3% to 83.5%, with four filtered inputs counted wrong. Short inputs, one location, label-only options and different API request formats limit the comparison.

                            gnana70 / Singularity Feed · 11 Nov 2026Source ↗
                            Benchmark · INDEPENDENT

                            In the same public Gemini Decision 1 run, a confidence cutoff of at least 0.9 keeps 1,176 of 2,000 items, with 1,153 correct (98.04%). The other 824 still need a separate policy. This is observed accuracy on that sample, not a guarantee for new traffic; four filtered inputs remain in the full denominator.

                            gnana70 / Singularity Feed · confidence and coverage · 11 Nov 2026Source ↗
                            Benchmark · VENDOR-REPORTED

                            The femto-jev maker reports 71.4% accuracy on SLURP with transcript plus audio frames, versus 58.6% using the transcript alone. On unseen MInDS-14 phone speech, the same paths score 55.8% and 56.1%. Audio features help on the familiar speech task but do not improve this unseen recording condition.

                            igorktech · femto-jev card · 11 Nov 2026Source ↗

                            Our benchmark · v0.1

                            We asked one model the same thing three ways and got different answers

                            Code and raw data →

                            Generated JSON

                            97.7ms

                            11 output tokens

                            Schema-constrained

                            74.4ms

                            7 output tokens

                            Direct readout

                            24.6ms

                            1 output token

                            • constrained vs direct76%
                            • generated vs constrained68%
                            • generated vs direct48%

                            The fastest path was also the least varied. On this 0.6B model the direct readout answered technical in 69 of 75 calls and never once said billing, on a set that includes "my card was charged twice". Without labels we can't score accuracy, but an answer that barely changes is a warning sign. Whether a purpose-trained decision model avoids this is the open question.

                            Model
                            Qwen3 0.6B, Q4_K_M
                            Runtime
                            Ollama 0.33.2
                            Machine
                            Apple M3 Pro, 36 GB
                            Calls
                            25 inputs × 3 repeats × 3 paths
                            Temperature
                            0
                            Run
                            17 Sep 2026

                            Medians over 75 timed calls per path. This measures mechanics, not accuracy: there are no ground-truth labels, so "disagree" means the paths differ, not that one is right. Local latency says nothing about any hosted API. Raw results · Summary

                            Lineage · 2017 to 2026

                            Earlier research that Jev builds on

                            When Jev launched on 15 September 2026, a GLiNER2 co-author answered by pointing readers to weights already on Hugging Face. The papers trace which parts of the idea predate Jev and which are new. Every entry is checked against arXiv or Hugging Face.

                            1. 2017On Calibration of Modern Neural Networks Source ↗Guo, Pleiss, Sun, WeinbergerShowed that modern networks are systematically overconfident, and that a probability is not a calibrated probability until someone measures it.
                            2. 2018BERT Source ↗Devlin, Chang, Lee, ToutanovaSequence-classification heads over a bidirectional encoder: state in, bounded label out, no text generated.
                            3. 2019Zero-shot classification via entailment Source ↗Yin, Hay, RothArbitrary label sets declared at inference time with no per-task training. The 'declare your options' interface, seven years before Jev.
                            4. 2023Function calling, then Structured Outputs Source ↗OpenAISchema-valid objects straight from an API. Structured Outputs added strict JSON Schema enforcement in August 2024.
                            5. 2023Guided generation Source ↗Willard & LoufFinite-state-machine constrained decoding: the answer space enforced during generation rather than validated after it.
                            6. 2023GLiNER Source ↗Zaratiana, Tomeh, Holat, CharnoisA compact open-weight encoder that matches any entity type you name at inference time, in parallel rather than by generating. Not a general decision model, but the closest open ancestor the community pointed to.
                            7. 2023Llama Guard Source ↗Inan et al., MetaA safety classifier with bounded labels as the whole product, built as a language model that outputs its verdict. ShieldGemma followed in July 2024.
                            8. 2025GLiNER2 Source ↗Zaratiana, Pasternak, Boyd, Hurn-Maloney, Lewis (Fastino)Multi-task extraction and classification through a schema-based interface, several tasks in one forward pass, running on CPU.
                            9. 2026GLiGuard Source ↗FastinoA 0.3B schema-conditioned encoder judging prompt safety, response safety, refusal, 14 harm categories and 11 jailbreak strategies in one non-autoregressive forward pass. Apache-2.0 weights on Hugging Face.
                            10. 2026Jev Source ↗TypeSafe AIA hosted model trained specifically for calibrated typed decisions, with Choice, Score and Noul primitives. The weights stay locked: as of 20 Oct 2026, TypeSafe's Hugging Face org has published eval datasets but not a single model.

                            Resources

                            Where to read more

                            Start here

                            • Introducing System One Models and Jev Source ↗

                              TypeSafe AI's launch post, 15 Sep 2026, gave the category its name.

                            • Jev introduces a new shape of LLM Source ↗

                              Simon Willison's hands-on write-up, 21 Sep 2026. The clearest independent explainer.

                            • A Deep Dive into Decision Models Source ↗

                              Joe Barrow, an NLP researcher at Adobe Research, explains how decision models work through an open one, Perplexity's Decider v1.2: the architecture, how it is served, what its design says about training, and when to use one. An X article, 30 Oct 2026.

                            • Building open decision models for on-device agents Source ↗

                              Leonie Monigatti’s slides, shared with her 6 Nov 2026 talk thread. They explain why reading option logits still needs fine-tuning and calibration. The overconfidence charts are illustrations without an identified evaluation set.

                            • Latent Space: System One models for Prod, not God Source ↗

                              Interview with Diogo Almeida, TypeSafe CEO, 21 Sep 2026. The fullest statement of their thesis, including RLCD.

                            • The launch thread on Hacker News Source ↗

                              Nearly 2,000 points and over 500 comments. The sharpest pushback is in here.

                            Papers

                            • Typed Decision Models: An Early Evidence Audit Source ↗

                              Reviews the first 28 papers and proposes a 14-item evaluation checklist. 26 Sep 2026.

                            • Beyond Calibration: do typed-decision probabilities obey the axioms? Source ↗

                              A label-free coherence test, run on Jev and an open 27B model. 27 Sep 2026.

                            • Decision models as layers in a pentest agent Source ↗

                              An exploratory case study of Jev inside an LLM pentest agent, plus a discussion of Laya's published specs. 24 Sep 2026.

                            Benchmarks

                            • JevBench Source ↗

                              Independent leaderboard on intelligence, calibration, speed and cost. Not affiliated with TypeSafe.

                            • DecisionBench Source ↗

                              Ours. Three output paths on one model, with the hardware published.

                            Run one yourself

                            Community

                            • AbdelStark/awesome-typesafe Source ↗

                              Community-maintained list of TypeSafe, System One and Jev resources. Scoped to that ecosystem, not a general decision-model index.

                            • System One Models Source ↗

                              Another independent directory of decision models, with recipes and guides.

                            • @decision_models on X Source ↗

                              Where this site posts new releases first.