Models › GLiNER2.5 family

GLiNER2.5-Decide

fastino Apache 2.0 out 32 days ago

486M parameters, text in, labels out.

Verified 2026-10-25 Rank #0 in Decision models · score 0 method v1 Sources 3 Downloads 30d 151.4k · #270 of 619 tracked

Can I run it?0.3GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?151.4kdownloads, 30 days#270 of 619 we track · top 44%+11 likes, downloads +31% this week428 likesHugging Face2026-10-24

Worth reading

Picked by rule from 1 tracked piece: the lab's own post, the most shared, a field report, the latest.

Latest · 28 days ago

GLiNER2.5-Decide and Jev: a decision model you run, and one you call

GLiNER2.5-Decide is a 340M-parameter DeBERTa-v3-large encoder released under Apache-2.0 that runs natively on Macs via MLX Swift.

  • The Swift port rejects inputs longer than 512 encoded tokens per request.
  • JevK5 is an open reproduction using a 4B-class Qwen3.5 decoder, not TypeSafe's commercial model.
soniqo.audio 2026-09-27 4 HN pts 1.6k words

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 12 quantized builds and 15 Spaces.

  • As a service0no API provider listed
  • On own hardware12quantized builds
  • Built on1614 fine-tunes · 2 adapters · 0 merges
  • In apps15Hugging Face Spaces

Top Spaces running it: multimodalart/jev-decision-index ♥ 802 · fastino/gliner25-decide-playground ♥ 14 · hugging-apps/gliner25-decide-demo ♥ 3 · davanstrien/topic-feed-lab ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.3 GB at INT4, 0.6 GB at FP8, 1.2 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.3 GB of weights (estimate; KV cache and activations extra)INT40.3 GBFP8: about 0.6 GB of weights (estimate; KV cache and activations extra)FP80.6 GBBF16: about 1.2 GB of weights (estimate; KV cache and activations extra)BF161.2 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.3 GB of weights (estimate; KV cache and activations extra)INT40.3 GBFP8: about 0.6 GB of weights (estimate; KV cache and activations extra)FP80.6 GBBF16: about 1.2 GB of weights (estimate; KV cache and activations extra)BF161.2 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

1 dated article and 26 repo commits so far

Teal is the weights (2026-09-23), amber triangles are 1 dated article (each links to it), grey ticks are repo commits.

Oct2026-10-08: 5 repo commits2026-09-28: 2 repo commits2026-09-24: 17 repo commits2026-09-23: 2 repo commitsGLiNER2.5-Decide and Jev: a decision model you run, and one you call · 2026-09-27Weights 2026-09-23 · 2026-09-23Weights 2026-09-23now
Oct2026-10-08: 5 repo commits2026-09-28: 2 repo commits2026-09-24: 17 repo commits2026-09-23: 2 repo commitsGLiNER2.5-Decide and Jev: a decision model you run, and one you call · 2026-09-27Weights 2026-09-23 · 2026-09-23Weights 2026-09-23now

What people built on it

28 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

28 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

12 quantized (Hugging Face model tree)14 fine-tunes (Hugging Face model tree)2 adapters (Hugging Face model tree)12 quantized14 fine-tunes2 adapters
12 quantized (Hugging Face model tree)14 fine-tunes (Hugging Face model tree)2 adapters (Hugging Face model tree)12 quantized14 fine-tunes2 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Benchmarks

1 row

Benchmarks 1 row

measured third-party leaderboard rowauthor-reported number from the model card or eval files (1)No confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
BenchmarkValueSetting / notesReported byDate
author-reported Exact-match accuracy on fastino/fast-decisions60.2% percentGLiNER2.5-Decide (340M)model author2026-10-09

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

17 fields

Listed in Decision models

Facts

Pipeline tagtext-classification
Librarytransformers
ArchitecturesSpanExtractor
Model typeextractor
Params by dtypeF32: 486,444,053
Size bandS
MoEno
Languagesen
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: not in registry · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for GLiNER2.5-Decide: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)1.2 GB · Edge (<4 GB)
FP8 (1 byte/param)0.6 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.3 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

Decision facts

catalog

Decision-model catalog curated

How it was madefull fine-tune of vendor own GLiNER2 encoder
Lineage bucketO - original architecture or own base
Lineage evidenceHF base_model fastino/gliner2-large-v1 (vendor own architecture)
Base modelfastino/gliner2-large-v1
DI 0.2.1 score11.21 (independent (DI 0.2.1 board))
ECE (board)0.0884
Median latency23.3 ms (DI board, 1x RTX PRO 6000, single process)
Hosted price (input)self-hosted/M
Sourcehttps://huggingface.co/fastino/GLiNER2.5-Decide

All variants

28 variants

Lineage

Fine-tuned from fastino/gliner2-large-v1 (same organization) Family: fastino/GLiNER2.5 28 derivatives on the Hub

Base model: fastino/gliner2-large-v1

quantized: 12finetune: 14adapter: 2

Top variants (28 shown, ranked by downloads)

Relation
Quant
28 rows
Variant Relation Quant Params Band License Author Likes Downloads
FluidInference/gliner2-5-decide-coreml quantized — — — apache-2.0 FluidInference 24 659
litert-community/GLiNER2.5-Decide-LiteRT finetune — — — apache-2.0 litert-community 11 597
onnx-community/GLiNER2.5-Decide-ONNX quantized — — — apache-2.0 onnx-community 2 937
antflydb/GLiNER2.5-Decide quantized GGUF — — apache-2.0 antflydb 0 574
onnx-community/GLiNER2.5-Decide-mobile-ONNX quantized — — — apache-2.0 onnx-community 1 350
yale-cultural-heritage/GLiNER2.5-Decide-linkedart-recon finetune — 486M S cc-by-nc-4.0 yale-cultural-heritage 4 146
aufklarer/GLiNER2.5-Decide-340M-MLX-8bit finetune MLX — — apache-2.0 aufklarer 0 189
yannelli/gliner2.5-decide-code-review-decisions finetune — 486M S apache-2.0 yannelli 2 48
kgrozdanovski/caldec-v1-gliner2.5-decide finetune — 486M S apache-2.0 kgrozdanovski 2 37
mlboydaisuke/GLiNER2.5-Decide-CoreAI quantized — — — apache-2.0 mlboydaisuke 1 84
aufklarer/GLiNER2.5-Decide-340M-MLX finetune MLX — — apache-2.0 aufklarer 0 129
aufklarer/GLiNER2.5-Decide-340M-MLX-fp16 finetune MLX — — apache-2.0 aufklarer 0 128
coreai-community/GLiNER2.5-Decide-CoreAI quantized — — — apache-2.0 coreai-community 0 100
nativ-community/GLiNER2.5-Decide finetune — 436M S apache-2.0 nativ-community 0 86
TyrusRC/haruspex finetune — — — apache-2.0 TyrusRC 0 81
souuzaa/GLiNER2.5-Decide-8bit quantized -8bit 486M S apache-2.0 souuzaa 0 74
souuzaa/GLiNER2.5-Decide-4bit quantized -4bit 486M S apache-2.0 souuzaa 0 69
abdelstark/exitreceipt-gliner2.5-decide-lora adapter — — — apache-2.0 abdelstark 0 63
souuzaa/GLiNER2.5-Decide-bf16 quantized -bf16 486M S apache-2.0 souuzaa 0 62
nishparadox/gliner2.5-decide-onnx quantized — — — apache-2.0 nishparadox 1 0
hmarchant/gliner2.5-decide-person-resolution finetune — 486M S apache-2.0 hmarchant 0 49
augustoFranke/GLiNER2.5-Decide-CoreML-FP16-MultiFn-L64-512 quantized -FP16 — — apache-2.0 augustoFranke 0 13
smdesai/GLiNER25-Decide-FP16-CoreML quantized -FP16 — — apache-2.0 smdesai 0 11
coral-bricks-ai/gliner2.5-decide-call-actions finetune — 486M S apache-2.0 coral-bricks-ai 0 8
smdesai/GLiNER25-Decide-FP16-CoreAI finetune -FP16 — — apache-2.0 smdesai 0 0
openbles/firewall-1 adapter — — — mit openbles 0 0
TyrusRC/haruspex-adapters finetune — — — apache-2.0 TyrusRC 0 0
brenorb/doc-quality finetune — — — — brenorb 0 0

Repository changelog

26 commits

Repository changelog 26 commits

DateCommitSHA
2026-10-08 Install with the local extra; tag as text-classification (#8) 9d1bfb8
2026-10-08 Install with the local extra: pip install "gliner2[local]" (#13) b0c78b4
2026-10-08 Add a Fine-tuning section with training-row formats (#12) f87a56c
2026-10-08 Load this checkpoint as a Transformers schema-extraction model. (#11) 2125c8a
2026-10-08 Add decision-model tag (#10) a6ef71c
2026-09-28 Point the fine-tune button to agent.fastino.ai 5a7adf7
2026-09-28 Point the fine-tune banner to agent.fastino.ai ec2a5d1
2026-09-24 Normalize model card and move benchmark near top 7ee5da4
2026-09-24 Update the Fastino GLiNER skill af5e41e
2026-09-24 Update GLiNER2 deployment badge link (#6) bbe10ff
2026-09-24 Update GLiNER2.5 fine-tuning badge link (#5) 01eaa61
2026-09-24 Update Fastino API link (#4) 55dba8d
2026-09-24 Update the Fastino GLiNER skill 65624f1
2026-09-24 Mention hosted fine-tuning via the Fastino API (#3) 0872ab1
2026-09-24 Update the Fastino GLiNER skill 4069ac8
2026-09-24 Add the Fastino GLiNER skill 79c3fb9
2026-09-24 Point the benchmark at fastino/fast-decisions 8d7170d
2026-09-24 Add question, book, label, and ordinal examples b49028a
2026-09-24 Explain each classification use case on the model card 1e2df4e
2026-09-24 Rewrite the model card for release ee4abe5
2026-09-24 Add classification task examples to the model card f05b122
2026-09-24 Update to step 126500 with benchmark table da05b29
2026-09-24 upload banner (#1) bb8e3f9
2026-09-24 update banner (#2) 3846d9d
2026-09-23 Upload large classification finetune at step 95500 91c8b6b
2026-09-23 initial commit e4ab809

Articles and coverage

1 piece

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis1

soniqo.audio2026-09-27HN 4 pts · 0 comments1,583 words
GLiNER2.5-Decide is a 340M-parameter DeBERTa-v3-large encoder released under Apache-2.0 that runs natively on Macs via MLX Swift. Jev is TypeSafe's hosted API costing $42 per billion input tokens, supporting up to 64k tokens per request with mixed question types. Benchmarks show GLiNER achieving 38.3 ms p50 latency on a V100, while Jev evaluates typed questions against state in parallel without generating text.written, reviewed, cited
  • The Swift port rejects inputs longer than 512 encoded tokens per request.
  • JevK5 is an open reproduction using a 4B-class Qwen3.5 decoder, not TypeSafe's commercial model.
  • INT8 quantization requires a third of the FP32 memory while keeping confidence within 0.006.

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • lavoir · 422M
    same size band (S), same task (text-classification)
  • laya · 421M
    same size band (S), same task (text-classification), permissive license
  • laya-typed-decisions · 421M
    same size band (S), same task (text-classification), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:43 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:18 UTC · Last verified 2026-10-25

Follow GLiNER2.5-Decide

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.