Models › LFM2.5 family

LFM2.5-2.6B-RLCD

monotykamary lfm1.0 out 39 days ago

2.70B parameters, text in, text out, 128K tokens of context.

Verified 2026-10-25 Rank #0 in Decision models · score 0 method v1 Sources 3 Downloads 30d 463 · #608 of 619 tracked

Can I run it?1.6GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?lfm1.0Custom license; read the repo LICENSE before commercial hostinglicence file2026-10-24
Do people use it?463downloads, 30 days#608 of 619 we track · below the median+0 likes, downloads −33% this week8 likesHugging Face2026-10-24

Worth reading

Picked by rule from 10 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 18 HN pts

LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacB

Liquid AI releases DSpark draft models for LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B, integrating speculative decoding via llama.cpp and SGLang.

  • The 8B-A1B draft model adds 65.5M parameters for its Markov head compared to 33.6M in the 1.2B and 2.6B variants.
  • For the 1.2B-Instruct draft, validation loss consistently tracks acceptance rate improvements across all training epochs.
liquid.ai 2026-08-21 18 HN pts 1.9k words about the LFM2.5 family family
Latest · 3 months ago

LFM2.5-Encoders for Fast Long-Context Inference on CPU

Liquid AI releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, two new models designed for fast long-context inference on CPU.

  • The 350M variant is the choice when accuracy matters most.
  • The 230M variant is the choice for tighter hardware or higher throughput.
huggingface.co 2026-08-06 1 HN pts 1.1k words about the LFM2.5 family family

10 best of 10 tracked

The 3 picks above, plus these 7. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleLFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edgeliquid.ai · 2026-08-12
  2. ArticleLFM2.5-8B-A1B: An Even Better On-Device Mixture-of-Expertsliquid.ai · 2026-05-28
  3. ArticleAccomplishing More with LFM2.5-VL-DSpark2tinteractive.com · 2026-09-24
  4. ArticleLFM2.5-2.6B: On-Device Agentsdocs.liquid.ai · 2026-08-04 · 3 HN pts
  5. ArticleLFM2.5-350M: No Size Left Behindliquid.ai · 2026-04-01
  6. DiscussionLFM2.5-350Mtwitter.com · 2026-04-02
  7. ArticleLFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloudliquid.ai · 2026-04-27

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 7 Spaces.

  • As a service0no API provider listed
  • On own hardware0quantized builds
  • Built on00 fine-tunes · 0 adapters · 0 merges
  • In apps7Hugging Face Spaces

Top Spaces running it: multimodalart/jev-decision-index ♥ 802

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 1.6 GB at INT4, 3.2 GB at FP8, 6.5 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.6 GB of weights (estimate; KV cache and activations extra)INT41.6 GBFP8: about 3.2 GB of weights (estimate; KV cache and activations extra)FP83.2 GBBF16: about 6.5 GB of weights (estimate; KV cache and activations extra)BF166.5 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 1.6 GB of weights (estimate; KV cache and activations extra)INT41.6 GBFP8: about 3.2 GB of weights (estimate; KV cache and activations extra)FP83.2 GBBF16: about 6.5 GB of weights (estimate; KV cache and activations extra)BF166.5 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2026-09-16), amber triangles are 4 dated articles (each links to it), grey ticks are repo commits.

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

The model implements Parallel Constrained Decoding to perform fast finite-choice structured inference.[1]

  1. “Fast finite-choice structured inference using unchanged L…”

Generated 2026-10-07 15:19 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in Decision models

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesLfm2ForCausalLM
Model typelfm2
Dtypebfloat16
Params by dtypeBF16: 2,697,198,592
Size bandM
MoEno
Context length131,072 (config.json max_position_embeddings)
Languagesar, zh, en, fr, de, hi, id, it, ja, ko, pl, pt, ru, es, th, vi
Licenselfm1.0 (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Lfm2ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Lfm2ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for LFM2.5-2.6B-RLCD: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)6.5 GB · Single GPU (<24 GB)
FP8 (1 byte/param)3.2 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)1.6 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

Decision facts

catalog

Decision-model catalog curated

How it was madere-upload of stock LiquidAI weights + parallel constrained decoding code
Lineage bucketW - wrapper: inference technique on stock weights or API wrapper
Lineage evidencemodel card ("unchanged LiquidAI/LFM2.5-2.6B weights"; no training). Board file rule labels it full fine-tune because it re-uploads weights
Base modelLiquidAI/LFM2.5-2.6B-Base
DI 0.2.1 score6.76 (independent (DI 0.2.1 board))
ECE (board)0.2545
Median latency39.3 ms (DI board, 1x RTX PRO 6000, single process)
Hosted price (input)self-hosted/M
Notes Board raised a capacity limit ("lifted").
Sourcehttps://huggingface.co/monotykamary/LFM2.5-2.6B-RLCD

All variants

lineage

Lineage

Fine-tuned from LiquidAI/LFM2.5-2.6B Family: monotykamary/LFM2.5 0 derivatives on the Hub

Base model: LiquidAI/LFM2.5-2.6B

Repository changelog

2 commits

Repository changelog 2 commits

DateCommitSHA
2026-09-16 feat: add verified inference-only parallel constrained decoding 3145545
2026-09-16 initial commit f5fe772

Articles and coverage

10 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official4

liquid.ai2026-08-21about the LFM2.5 familyHN 18 pts · 0 comments1,933 words
Liquid AI releases DSpark draft models for LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B, integrating speculative decoding via llama.cpp and SGLang. The draft models use 5 layers with a block size of 9 and total approximately ~300M parameters, achieving up to 3.18x GPU speedup and up to 2.87x on-device gains for the 2.6B variant. While the 1.2B and 2.6B models see consistent improvements, the 8B-A1B variant only achieves an 18% improvement on edge devices due to current MoE implementation constraints in llama.cpp's Metal backend.written, reviewed, cited
  • The 8B-A1B draft model adds 65.5M parameters for its Markov head compared to 33.6M in the 1.2B and 2.6B variants.
  • For the 1.2B-Instruct draft, validation loss consistently tracks acceptance rate improvements across all training epochs.
  • The 8B-A1B draft model achieves only an 18% improvement on edge devices because verifying k tokens activates more experts and weight traffic.
huggingface.co2026-08-06authorityabout the LFM2.5 familyHN 1 pts · 0 comments1,103 words
Liquid AI releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, two new models designed for fast long-context inference on CPU. These encoders support an 8,192-token context and are about 3.7× faster than ModernBERT-base at long context lengths. The models are trained with a masked language objective that masks 30% of tokens during training to achieve strong performance on GLUE, SuperGLUE, and multilingual tasks.written, reviewed, cited
  • The 350M variant is the choice when accuracy matters most.
  • The 230M variant is the choice for tighter hardware or higher throughput.
  • A base encoder provides general-purpose representations rather than direct task outputs.
docs.liquid.ai2026-08-04HN 3 pts · 0 comments161 words
LFM2.5-2.6B is Liquid AI's 2.6B dense model built for agentic workloads with a 131K context window and native tool calling. It runs on edge devices and is trained to work reliably inside agent harnesses like Hermes Agent, OpenClaw, and Pi. The chat template opens every assistant turn with a <think> tag so responses contain an explicit chain of thought before the final answer. Users can run it via Transformers, llama.cpp, vLLM, or SGLang.written, reviewed, cited
liquid.ai2026-08-04HN 3 pts · 0 comments1,566 words
Liquid AI releases LFM2.5-2.6B, a 2.6B parameter agentic model trained on ~34T tokens and available on Hugging Face. It features a 128K vocabulary and context-extension phase, decoding 220 tokens/s on an M5 Max and 113 tokens/s on a Ryzen AI Max+ 395 while staying under 2.5 GB. The model reaches 15K output tokens per second on an H100 GPU.written, reviewed, cited
  • The model doubles its vocabulary to 128K by extending the existing tokenizer in place rather than retraining the model from scratch.
  • Training uses a dedicated 128K context-extension phase so the model can handle the long inputs that agentic workloads require.
  • The training pipeline separates model optimization, inference, and environment execution into distinct components using FSDP, SGLang, and verl.
All coverage tracked for this model (10) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Accomplishing More with LFM2.5-VL-DSpark2tinteractive.com2026-09-242026-10-07hn
LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacBliquid.ai2026-08-212026-10-07hn
LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edgeliquid.ai2026-08-122026-10-07hn
LFM2.5-Encoders for Fast Long-Context Inference on CPUhuggingface.co2026-08-062026-10-07hn
LFM2.5-2.6B: On-Device Agentsdocs.liquid.ai2026-08-042026-10-07hn
LFM2.5-2.6B: Deploy Agents Everywhereliquid.ai2026-08-042026-10-07hn
LFM2.5-8B-A1B: An Even Better On-Device Mixture-of-Expertsliquid.ai2026-05-282026-10-07hn
LFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloudliquid.ai2026-04-272026-10-07hn
LFM2.5-350Mtwitter.com2026-04-022026-10-07hn
LFM2.5-350M: No Size Left Behindliquid.ai2026-04-012026-10-07hn

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:44 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:19 UTC · Last verified 2026-10-25

Follow LFM2.5-2.6B-RLCD

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.