Models › OLMo family

allenai Apache 2.0 out 3 years ago

6.89B parameters, text in, text out.

Verified 2026-10-25 Rank #720 in LLMs · score 71.7 method v1 Sources 3 Downloads 30d 8.8k · #516 of 619 tracked

Can I run it?4.1GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file
Do people use it?8.8kdownloads, 30 days#516 of 619 we track · below the median656 likesHugging Face

Worth reading

Picked by rule from 21 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 64 HN pts

Mlx-community/OLMo-2-0325-32B-Instruct-4bit

OLMo 2 32B claims to be the first fully-open model to outperform GPT3.5-Turbo and GPT-4o mini.

simonwillison.net 2025-03-16 64 HN pts · 23 comments 195 words about the OLMo family family
Latest · 18 days ago

Olmo-core 3: Open, scalable training infrastructure for large MoEs

Ai2 releases Olmo-core 3, an open framework for training large mixture-of-experts models that scales efficiently into the trillion-parameter range.

  • Lowering experts' learning rates because they process fewer tokens did not improve results in the model family tested.
  • Overlapping communication and computation on separate GPU streams did not always make training faster and sometimes slowed execution.
allenai.org 2026-10-07 3 HN pts 1.4k words about the OLMo family family

21 best of 21 tracked

The 2 picks above, plus these 19. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. PaperNCP-ArchPreview: 8.9B latent LM matches OLMo-3-7B on 51% of tokensarxiv.org · 2026-09-14 · 2 HN pts
  2. ArticleReproducing Olmo 3 7B Pre-trainingdevelopers.googleblog.com · 2026-09-29 · 1 HN pts
  3. ArticleOlmo 3: Charting a path through the model flow to lead open-source AIallenai.org · 2025-11-20 · 390 HN pts · official
  4. ArticleHello OLMo: A truly open LLMblog.allenai.org · 2024-04-08 · 398 HN pts · official
  5. ArticleOLMo: Accelerating the Science of Language Models [pdf]allenai.org · 2024-02-02 · 141 HN pts · official
  6. ArticleOLMo 2 - a family of fully-open language modelsallenai.org · 2024-02-01 · 34 HN pts · official
  7. ArticleOlmo Hybridallenai.org · 2026-03-05 · 3 HN pts · official
  8. ArticleOLMo 2 32B: First fully open model to outperform GPT 3.5 and GPT 4o miniallenai.org · 2025-03-13 · 25 HN pts · official
  9. ArticleAMD Open-Source 1B OLMo Language Modelsamd.com · 2024-11-01
  10. ArticleOLMo: An Open LLM and Frameworkblog.allenai.org · 2024-02-01 · official
  11. ArticleHello OLMo: a Truly Open LLMblog.allenai.org · 2024-02-01 · official
  12. ArticleAI2 OLMo, an open language model made by scientists, for scientistsblog.allenai.org · 2023-05-11 · official
  13. ArticleOlmo 3 is a fully open LLMsimonwillison.net · 2025-11-23
  14. ArticleOLMo 1.7–7B: A 24 point improvement on MMLUblog.allenai.org · 2024-04-17 · official
  15. ArticleOlmo 3: America's open reasoning modelsinterconnects.ai · 2025-11-20
  16. ArticleOpen Language Models (OLMos) and the LLM Landscapeinterconnects.ai · 2024-02-01
  17. ArticleAMD Announces OLMo, Its First Open LLMextremetech.com · 2024-11-10
  18. ArticleOlmo 3 and the Open LLM Renaissancecameronrwolfe.substack.com · 2025-12-15
  19. DiscussionAi2 Olmo 3, a new SOTA open LLM (7B and 32B)twitter.com · 2025-11-20

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves.

  • As a service0no API provider listed
  • On own hardware0quantized builds
  • Built on77 fine-tunes · 0 adapters · 0 merges
  • In apps0Hugging Face Spaces

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.1 GB at INT4, 8.3 GB at FP8, 17 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.1 GB of weights (estimate; KV cache and activations extra)INT44.1 GBFP8: about 8.3 GB of weights (estimate; KV cache and activations extra)FP88.3 GBBF16: about 17 GB of weights (estimate; KV cache and activations extra)BF1617 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.1 GB of weights (estimate; KV cache and activations extra)INT44.1 GBFP8: about 8.3 GB of weights (estimate; KV cache and activations extra)FP88.3 GBBF16: about 17 GB of weights (estimate; KV cache and activations extra)BF1617 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

10 dated articles and 0 repo commits so far

Teal is the weights (2024-01-09), amber triangles are 10 dated articles (each links to it).

What people built on it

7 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

7 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

7 fine-tunes (Hugging Face model tree)7 fine-tunes
7 fine-tunes (Hugging Face model tree)7 fine-tunes

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

14 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesOLMoForCausalLM
Model typehf_olmo
Params by dtypeF32: 6,888,095,744
Size bandM
MoEno
PapersarXiv:2402.00838, arXiv:2302.13971
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for OLMo-7B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)17 GB · Single GPU (<24 GB)
FP8 (1 byte/param)8.3 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.1 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

7 variants

Lineage

Original model Family: allenai/OLMo 7 derivatives on the Hub

finetune: 7

Top variants (7 shown, ranked by downloads)

7 rows
Variant Relation Quant Params Band License Author Likes Downloads
itay1itzhak/OLMo-Tulu-Seed-0 finetune — 6.89B M mit itay1itzhak 0 326
joseagmz/olmo-7B-Tinybook-epochs-1-lr-0002 finetune — — — apache-2.0 joseagmz 0 246
itay1itzhak/OLMo-Tulu-Seed-1 finetune — 6.89B M mit itay1itzhak 0 201
itay1itzhak/OLMo-Flan-Seed-0 finetune — 6.89B M apache-2.0 itay1itzhak 0 142
itay1itzhak/OLMo-Flan-Seed-2 finetune — 6.89B M mit itay1itzhak 0 136
itay1itzhak/OLMo-Tulu-Seed-2 finetune — 6.89B M apache-2.0 itay1itzhak 0 123
itay1itzhak/OLMo-Flan-Seed-1 finetune — 6.89B M apache-2.0 itay1itzhak 0 112

Articles and coverage

21 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official8

allenai.org2026-10-07officialauthorityabout the OLMo familyHN 3 pts · 0 comments1,392 words
Ai2 releases Olmo-core 3, an open framework for training large mixture-of-experts models that scales efficiently into the trillion-parameter range. The system increases the expert pool to 128 while selecting only four experts per token, keeping active parameters fixed at about 3.2B. Benchmarks on NVIDIA B300 GPUs show the new stack achieves about 2.7× the throughput of earlier implementations, and enabling MXFP8 raises training throughput by about 21% while lowering peak active memory from 103 GiB to 95 GiB.written, reviewed, cited
  • Lowering experts' learning rates because they process fewer tokens did not improve results in the model family tested.
  • Overlapping communication and computation on separate GPU streams did not always make training faster and sometimes slowed execution.
  • Performance comparisons require matching input values as well as matching shapes because GPU calculations vary with processed values.
developers.googleblog.com2026-09-29authorityabout the OLMo familyHN 1 pts · 0 comments5,194 words
Google Cloud reproduced the Allen Institute for AI's Olmo 3 7B model using MaxText on TPUs, matching the original training loss curve and held-out metrics. The team converted the PyTorch architecture to JAX, implementing a reordered-norm block, QK-norm, and 3:1 sliding/global attention while catching a data-loader bug that caused memorization. The run tracked the full ~5.93T-token / 1.41M-step budget, sustaining 57.4% MFU on v5p devices during stage 2.written, reviewed, cited
  • The team lost three quarters of capacity mid-run but resumed on a quarter-sized slice with no recipe change.
allenai.org2025-11-20officialauthorityHN front pageabout the OLMo familyHN 390 pts · 125 comments3,773 words
AllenAI released Olmo 3.1 Think 32B and Olmo 3.1 Instruct 32B, the most performant checkpoints to date. The Think variant extended the best reinforcement learning run with an additional 21 days on 224 GPUs, yielding improvements of 5+ points on AIME, 4+ points on ZebraLogic, 4+ points on IFEval, and 20+ points on IFBench. The Instruct variant applies the recipe behind Olmo 3 Instruct 7B to a larger model for chat and tool use.written, reviewed, cited
  • Olmo 3-Think (32B) narrows the gap to top open models while training on roughly 6x fewer tokens than competitors.
  • The model flow allows users to swap in domain-specific data during mid-training or adjust post-training for specific use cases.
  • Olmo 3-Base (32B) achieves competitive performance with Qwen 2.5 and Gemma 3 while maintaining full openness of weights and code.
blog.allenai.org2024-04-08officialauthorityHN front pageabout the OLMo familyHN 398 pts · 67 comments1,123 words
The Allen Institute for AI released OLMo 7B, a truly open large language model alongside its pre-training data and training code. The model is built on Ai2's Dolma set featuring a three trillion token open corpus for language model pretraining. Four model variants at the 7B scale were trained to at least 2T tokens with 500+ checkpoints per model available for evaluation. Development utilized the LUMI Supercomputer, which supported the pre-training work necessary to develop OLMo.written, reviewed, cited
  • One training run currently produces emissions equivalent to nine US homes for one year.
  • The LUMI supercomputer in Finland is known for its entirely carbon-free operations.
  • OLMo was developed on the Mosaic AI model training platform from Databricks.
allenai.org2024-02-02officialauthorityHN front pageabout the OLMo familyHN 141 pts · 52 comments
allenai.org2024-02-01officialauthorityabout the OLMo familyHN 34 pts · 4 comments372 words
The Olmo 3 model family offers a complete model flow with full access to training data, logs, and the entire lifecycle. Variants include 32B-Base for math and programming, 32B-Think for complex reasoning, 32B-Instruct for chat, 7B-Base for lightweight deployment, and 7B-Think for efficient reasoning. Open-source tools like Duplodocus and Datamap-rs support the development process.written, reviewed, cited
allenai.org2026-03-05officialauthorityabout the OLMo familyHN 3 pts · 0 comments498 words
allenai.org2025-03-13officialauthorityabout the OLMo familyHN 25 pts · 3 comments2,366 words
OLMo 2 32B is the first fully open model to outperform GPT 3.5 and GPT 4o mini on a suite of popular, multi-skill academic benchmarks. Trained up to 6T tokens using the OLMo-core framework on the Augusta 160-node cluster, it employs Group Relative Policy Optimization (GRPO) for post-training. The model requires only one third of the cost to train Qwen 2.5 32B while reaching similar performance.written, reviewed, cited
  • The model uses GPUDirect-TCPXO interconnects between nodes, each containing 8 H100 GPUs.
  • Training reached over 1800 tokens per second per GPU, achieving approximately 38% MFU.

Analysis2

arxiv.org2026-09-14authorityabout the OLMo familyHN 2 pts · 0 comments436 words
NCP-ArchPreview is a latent-space language model that pushes autoregressive pretraining beyond standard next-token prediction by learning to predict discrete concepts spanning multiple tokens. The 8.9B parameter model trains on 5.73T tokens from the Dolma-3 dataset, consuming only 51.3% of total training tokens to match OLMo-3-7B's loss while outperforming it by 2.45 points on the downstream macro-average and 5.99 points on GSM8K. Updating just the 17M-parameter VQ module yields a novel, lightweight interface for domain adaptation.written, reviewed, cited
simonwillison.net2025-03-16authorityabout the OLMo familyHN 64 pts · 23 comments195 words
OLMo 2 32B claims to be the first fully-open model to outperform GPT3.5-Turbo and GPT-4o mini. The model downloads to 17GB and requires the llm-mlx plugin to run on a Mac. Users must set the output token limit to unlimited because the default cap of 1024 is insufficient for tasks like generating an SVG of a pelican riding a bicycle.written, reviewed, cited
All coverage tracked for this model (21) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Olmo-core 3: Open, scalable training infrastructure for large MoEsallenai.org official2026-10-072026-10-23hn
Reproducing Olmo 3 7B Pre-trainingdevelopers.googleblog.com2026-09-292026-10-23hn
NCP-ArchPreview: 8.9B latent LM matches OLMo-3-7B on 51% of tokensarxiv.org2026-09-142026-10-23hn
Olmo Hybridallenai.org official2026-03-052026-10-23hn
Olmo 3 and the Open LLM Renaissancecameronrwolfe.substack.com2025-12-152026-10-23hn
Olmo 3 is a fully open LLMsimonwillison.net2025-11-232026-10-23hn
Olmo 3: America's open reasoning modelsinterconnects.ai2025-11-202026-10-23hn
Ai2 Olmo 3, a new SOTA open LLM (7B and 32B)twitter.com2025-11-202026-10-23hn
Olmo 3: Charting a path through the model flow to lead open-source AIallenai.org official2025-11-202026-10-23hn
Mlx-community/OLMo-2-0325-32B-Instruct-4bitsimonwillison.net2025-03-162026-10-23hn
OLMo 2 32B: First fully open model to outperform GPT 3.5 and GPT 4o miniallenai.org official2025-03-132026-10-23hn
AMD Announces OLMo, Its First Open LLMextremetech.com2024-11-102026-10-23hn
AMD Open-Source 1B OLMo Language Modelsamd.com2024-11-012026-10-23hn
OLMo 1.7–7B: A 24 point improvement on MMLUblog.allenai.org official2024-04-172026-10-23hn
Hello OLMo: A truly open LLMblog.allenai.org official2024-04-082026-10-23hn
OLMo: Accelerating the Science of Language Models [pdf]allenai.org official2024-02-022026-10-23hn
OLMo: An Open LLM and Frameworkblog.allenai.org official2024-02-012026-10-23hn
OLMo 2 - a family of fully-open language modelsallenai.org official2024-02-012026-10-23hn
Hello OLMo: a Truly Open LLMblog.allenai.org official2024-02-012026-10-23hn
Open Language Models (OLMos) and the LLM Landscapeinterconnects.ai2024-02-012026-10-23hn
AI2 OLMo, an open language model made by scientists, for scientistsblog.allenai.org official2023-05-112026-10-23hn

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-7B-Instruct · 7.62B
    same size band (M), same task (text-generation), more providers, permissive license
  • Mistral-7B-Instruct-v0.2 · 7.24B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-23 20:12 UTC · Last verified 2026-10-25

Follow OLMo-7B

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.