Models › system family

system-one-qwen3.5-4b-scorer-v2b

pngwn CC BY-NC 4.0 out 38 days ago

Verified 2026-10-25 Rank #0 in Decision models · score 0 method v1 Sources 3 Downloads 30d 141 · #616 of 619 tracked

Can I use it?CC BY-NC 4.0Non-commercial only; commercial hosting not permitted without a separate licenselicence file2026-10-24
Do people use it?141downloads, 30 days#616 of 619 we track · below the median+0 likes, downloads −58% this week6 likesHugging Face2026-10-24

Worth reading

Picked by rule from 2 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 1,989 HN pts

Introducing System One Models and Jev

TypeSafe AI releases Jev, a System One Model designed for fast, structured automation decisions.

  • Jev outputs all probabilities in parallel instead of autoregressively generating by token.
  • The model never makes type errors because possible outputs and structure are defined in advance.
typesafe.ai 2026-09-15 1,989 HN pts · 520 comments 2.2k words about the system family family

2 best of 2 tracked

The 1 pick above, plus these 1. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleLore – Open source version control system designed for scalabilitylore.org · 2026-06-17 · 1,276 HN pts

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 8 Spaces.

  • As a service0no API provider listed
  • On own hardware0quantized builds
  • Built on00 fine-tunes · 0 adapters · 0 merges
  • In apps8Hugging Face Spaces

Top Spaces running it: multimodalart/jev-decision-index ♥ 802

The story so far

Weights, every dated article, and repo commits on one rail.

2 dated articles and 5 repo commits so far

Teal is the weights (2026-09-17), amber triangles are 2 dated articles (each links to it), grey ticks are repo commits.

JulAugSepOct2026-09-17: 5 repo commitsIntroducing System One Models and Jev · 2026-09-15Lore – Open source version control system designed for scalability · 2026-06-17Weights 2026-09-17 · 2026-09-17Weights 2026-09-17now
JulAugSepOct2026-09-17: 5 repo commitsIntroducing System One Models and Jev · 2026-09-15Lore – Open source version control system designed for scalability · 2026-06-17Weights 2026-09-17 · 2026-09-17Weights 2026-09-17now

Reference

Everything else, folded: the full tables, every source.

Benchmarks

24 rows

Benchmarks 24 rows

measured third-party leaderboard rowauthor-reported number from the model card or eval files (24)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported ALL0.8—model author2026-10-07
author-reported ALL0.02—model author2026-10-07
author-reported ALL0.26—model author2026-10-07
author-reported choice0.63—model author2026-10-07
author-reported choice0.07—model author2026-10-07
author-reported choice0.49—model author2026-10-07
author-reported escalate0.92—model author2026-10-07
author-reported escalate0.07—model author2026-10-07
author-reported escalate0.14—model author2026-10-07
author-reported noul0.94—model author2026-10-07
author-reported noul0.03—model author2026-10-07
author-reported noul0.08—model author2026-10-07
author-reported review0.74—model author2026-10-07
author-reported review0.05—model author2026-10-07
author-reported review0.34—model author2026-10-07
author-reported severity0.75—model author2026-10-07
author-reported severity0.13—model author2026-10-07
author-reported severity0.36—model author2026-10-07
author-reported team1—model author2026-10-07
author-reported team0—model author2026-10-07
author-reported team0—model author2026-10-07
author-reported workflow40.84—model author2026-10-07
author-reported workflow40.05—model author2026-10-07
author-reported workflow40.2—model author2026-10-07

What the card says

2 cited sentences

Summary generated, cited

pngwn/system-one-qwen3.5-4b-scorer-v2b is a LoRA adapter based on Qwen/Qwen3.5-4B-Base designed for sequence classification.[1][2] The model scores question options in a single forward pass without autoregressive generation.[3]

  1. “base_model:Qwen/Qwen3.5-4B-Base”
  2. lineage kind
  3. “Scores each option of a typed question (yes/no, choice, s…”

Generated 2026-10-07 15:19 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

9 fields

Listed in Decision models

Facts

Librarypeft
MoEno
LicenseCC BY-NC 4.0 (cc-by-nc-4.0)
Hub snapshot2026-10-25

Decision facts

catalog

Decision-model catalog curated

How it was madeLoRA/adapter fine-tune
Lineage bucketF - fine-tune of an open model (public/synthetic data)
Lineage evidenceboard file inspection (adapter/head/weight files) + HF base_model field
Base modelQwen/Qwen3.5-4B-Base
DI 0.2.1 score29.91 (independent (DI 0.2.1 board))
ECE (board)0.0589
Median latency112.3 ms (DI board, 1x RTX PRO 6000, single process)
Hosted price (input)self-hosted/M
Contamination notes9,542 contaminated MMLU-Pro test items (in its training data) count as wrong; 5,308 contaminated MMLU test items (in its training data) count as wrong
Notes Board raised a capacity limit ("lifted").
Sourcehttps://huggingface.co/pngwn/system-one-qwen3.5-4b-scorer-v2b

All variants

lineage

Lineage

Adapter Family: pngwn/system 0 derivatives on the Hub

Base model: Qwen/Qwen3.5-4B-Base

Repository changelog

5 commits

Repository changelog 5 commits

DateCommitSHA
2026-09-17 add metrics.json 3ec7785
2026-09-17 add README.md 951dd00
2026-09-17 Upload tokenizer fa23575
2026-09-17 Upload model 30b2fcd
2026-09-17 initial commit 16a8fbc

Articles and coverage

2 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis2

typesafe.ai2026-09-15HN front pageabout the system familyHN 1,989 pts · 520 comments2,189 words
TypeSafe AI releases Jev, a System One Model designed for fast, structured automation decisions. Jev achieves similar intelligence to existing LLMs while being two orders of magnitude faster and more efficient, with end-to-end response times of 70ms-500ms compared to 3 to 329 seconds for frontier models. The model costs $0.042 per million input tokens and provides 40x-200x speedups for System One shaped queries by outputting calibrated probabilities in parallel rather than generating strings autoregressively.written, reviewed, cited
  • Jev outputs all probabilities in parallel instead of autoregressively generating by token.
  • The model never makes type errors because possible outputs and structure are defined in advance.
  • Jev supports a cardinality up to 255, requiring a two-stage system for higher choices.
lore.org2026-06-17HN front pageabout the system familyHN 1,276 pts · 680 comments52 words

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:44 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:19 UTC · Last verified 2026-10-25

Follow system-one-qwen3.5-4b-scorer-v2b

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.