Models › bloom family

bigscience BLOOM RAIL 1.0 out 4 years ago

176B parameters, text in, text out.

Verified 2026-10-25 Rank #195 in LLMs · score 89.4 method v1 Sources 3 Downloads 30d 11.8k · #499 of 619 tracked

Can I use it?BLOOM RAIL 1.0Attribution requiredlicence file2026-10-24
Do people use it?11.8kdownloads, 30 days#499 of 619 we track · below the median+5 likes, downloads −14% this week5,091 likesHugging Face2026-10-24

Worth reading

Picked by rule from 9 tracked pieces: the lab's own post, the most shared, a field report, the latest.

9 best of 9 tracked

The 1 pick above, plus these 8. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. Codebloom-megatron-deepspeed.mdgithub.com · undated
  2. ArticleBLOOM: A 176B-Parameter Open-Access Multilingual Language Modeljmlr.org · undated
  3. ArticleHuman Evaluation of Large Language Models: How Good is Hugging Face's BLOOM?surgehq.ai · undated
  4. ArticleRead More — Paper Graphpaper-graph-ui.vercel.app · undated
  5. ArticleBLOOM: An Open-Source Giant's Architecture and the Challenge of Scalesoftwarereviewreport.com · 2026-02-15
  6. ArticleBLOOM: A 176B-Parameter Open-Access Multilingual Language Model: Analysis, Review & Summary | Paperiumpaperium.net · 2025-12-01
  7. ArticleBloom, the model everyone hates... - Ed's Blogevandufraisse.github.io · 2024-01-19
  8. ArticleReview — BLOOM: A 176B-Parameter Open-Access Multilingual Language Model | by Sik-Ho Tsang | Mediumsh-tsang.medium.com · 2023-04-22

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 2 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware2quantized builds
  • Built on53 fine-tunes · 0 adapters · 2 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: uwnlp/guanaco-playground-tgi ♥ 507 · olivierdehaene/chat-llm-streaming ♥ 336 · huggingface/bloom_demo ♥ 286 · tomg-group-umd/lm-watermarking ♥ 100

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits two 80 GB GPUs at INT4; too big for one

About 106 GB at INT4, 212 GB at FP8, 423 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 106 GB of weights (estimate; KV cache and activations extra)INT4106 GBFP8: about 212 GB of weights (estimate; KV cache and activations extra)FP8212 GBBF16: about 423 GB of weights (estimate; KV cache and activations extra)BF16423 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 106 GB of weights (estimate; KV cache and activations extra)INT4106 GBFP8: about 212 GB of weights (estimate; KV cache and activations extra)FP8212 GBBF16: about 423 GB of weights (estimate; KV cache and activations extra)BF16423 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

5 dated articles and 30 repo commits so far

Teal is the weights (2022-05-19), amber triangles are 5 dated articles (each links to it), grey ticks are repo commits.

JulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-07-29: 1 repo commit2023-07-28: 1 repo commit2023-04-05: 1 repo commit2023-03-14: 2 repo commits2023-02-10: 2 repo commits2023-02-02: 1 repo commit2022-11-30: 2 repo commits2022-11-18: 1 repo commit2022-11-14: 1 repo commit2022-10-21: 1 repo commit2022-09-29: 1 repo commit2022-09-08: 2 repo commits2022-09-01: 2 repo commits2022-08-31: 2 repo commits2022-08-16: 1 repo commit2022-07-29: 1 repo commit2022-07-25: 1 repo commit2022-07-22: 1 repo commit2022-07-21: 1 repo commit2022-07-20: 1 repo commit2022-07-18: 2 repo commits2022-07-16: 1 repo commit2022-07-13: 1 repo commitShow HN: Bloom – A free and open source 'Google' · 2019-06-05BLOOM: An Open-Source Giant's Architecture and the Challenge of Scale · 2026-02-15Review — BLOOM: A 176B-Parameter Open-Access Multilingual Language Model | by Sik-Ho Tsang | Medium · 2023-04-22Bloom, the model everyone hates... - Ed's Blog · 2024-01-19BLOOM: A 176B-Parameter Open-Access Multilingual Language Model: Analysis, Review & Summary | Paperium · 2025-12-01Weights 2022-05-19 · 2022-05-19Weights 2022-05-19now
JulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2026-07-29: 1 repo commit2023-07-28: 1 repo commit2023-04-05: 1 repo commit2023-03-14: 2 repo commits2023-02-10: 2 repo commits2023-02-02: 1 repo commit2022-11-30: 2 repo commits2022-11-18: 1 repo commit2022-11-14: 1 repo commit2022-10-21: 1 repo commit2022-09-29: 1 repo commit2022-09-08: 2 repo commits2022-09-01: 2 repo commits2022-08-31: 2 repo commits2022-08-16: 1 repo commit2022-07-29: 1 repo commit2022-07-25: 1 repo commit2022-07-22: 1 repo commit2022-07-21: 1 repo commit2022-07-20: 1 repo commit2022-07-18: 2 repo commits2022-07-16: 1 repo commit2022-07-13: 1 repo commitShow HN: Bloom – A free and open source 'Google' · 2019-06-05BLOOM: An Open-Source Giant's Architecture and the Challenge of Scale · 2026-02-15Review — BLOOM: A 176B-Parameter Open-Access Multilingual Language Model | by Sik-Ho Tsang | Medium · 2023-04-22Bloom, the model everyone hates... - Ed's Blog · 2024-01-19BLOOM: A 176B-Parameter Open-Access Multilingual Language Model: Analysis, Review & Summary | Paperium · 2025-12-01Weights 2022-05-19 · 2022-05-19Weights 2022-05-19now

What people built on it

7 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

7 derivatives on the Hub, led by 3 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

2 quantized (Hugging Face model tree)3 fine-tunes (Hugging Face model tree)2 merges (Hugging Face model tree)2 quantized3 fine-tunes2 merges
2 quantized (Hugging Face model tree)3 fine-tunes (Hugging Face model tree)2 merges (Hugging Face model tree)2 quantized3 fine-tunes2 merges

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

BLOOM is a 176B parameter decoder-only autoregressive language model developed by bigscience.[1][2] It supports training data in 46 natural languages and 13 programming languages.[3]

  1. parameters human
  2. “Decoder-only architecture”
  3. “46 natural languages”

Generated 2026-10-07 15:04 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

18 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesBloomForCausalLM
Model typebloom
Params by dtypeBF16: 176,247,271,424
Size bandXXL
MoEno
Languagesak, ar, as, bm, bn, ca, code, en, es, eu, fon, fr, gu, hi, id, ig, ki, kn, lg, ln, ml, mr, ne, nso, ny, or, pa, pt, rn, rw, sn, st, sw, ta, te, tn, ts, tum, tw, ur, vi, wo, xh, yo, zh, zu
PapersarXiv:2211.05100, arXiv:1909.08053, arXiv:2110.02861, arXiv:2108.12409
LicenseBLOOM RAIL 1.0 (bigscience-bloom-rail-1.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · BloomForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for bloom: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)423 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)212 GB · Multi-GPU node (<640 GB)
INT4 (0.5 bytes/param)106 GB · Multi-GPU node (<640 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

7 variants

Lineage

Original model Family: bigscience/bloom 7 derivatives on the Hub

quantized: 2finetune: 3merge: 2

Top variants (7 shown, ranked by downloads)

Relation
7 rows
Variant Relation Quant Params Band License Author Likes Downloads
DevQuasar-13/bigscience.bloom-GGUF quantized GGUF — — — DevQuasar-13 1 2.7k
mradermacher/bloom-i1-GGUF quantized GGUF — — bigscience-bloom-rail-1.0 mradermacher 3 1.4k
12sebas/new_jar finetune — — — — 12sebas 0 436
Or4cl3-1/SAM-Gemini-BLOOM-OPT-Gopher-Megatron-slerp merge — — — — Or4cl3-1 0 0
Or4cl3-1/code-slerp merge — — — — Or4cl3-1 0 0
mradermacher/bloom-GGUF finetune GGUF — — bigscience-bloom-rail-1.0 mradermacher 0 0
MLap/bloom1.7-lora-sentiment-analysis-classification finetune — — — mit MLap 0 0

Repository changelog

30 commits

Repository changelog 30 commits

DateCommitSHA
2026-07-29 Fixed CO2 metadata in README.md (#293) 7f10a99
2023-07-28 Fix asset URL 053d9cd
2023-04-05 Upload model_00072-of-00072.safetensors (#230) 87cbfc8
2023-03-14 clarify 476113c
2023-03-14 add a link to https://huggingface.co/bigscience/bloom-intermediate/ 0a8c4dc
2023-02-10 Fix architecture (#189) ea51bbb
2023-02-10 Fix architecture (#188) dede1ba
2023-02-02 Fix typo in Examples (#181) b366374
2022-11-30 Update README.md f0e3b92
2022-11-30 Update README.md (#143) 0a1bf22
2022-11-18 Add safetensors index (#142) 4bf48c6
2022-11-14 Add carbon emissions metadata (#140) 20ac6a9
2022-10-21 Adding `safetensors` variant of this model (#121) 4d8e28c
2022-09-29 Fix dataset name 4ab0472
2022-09-08 Add exact param counts (#106) 0f24f91
2022-09-08 Fix mathematical reasoning (#103) c3a35dc
2022-09-01 Update default template for translation to spanish 11a7c1b
2022-09-01 Improve default translation prompts (#102) 8540347
2022-08-31 Fix #98 874fa44
2022-08-31 Remove incorrect evaluation results. (#98) 3f4b529
2022-08-16 Correct HumanEval scores (#79) aee8c40
2022-07-29 Widget multiline examples correct behaviour (#67) d9bf58e
2022-07-25 cross link to meg-ds checkpoint 9e27a90
2022-07-22 Add Lingala (#60) 2a3d62e
2022-07-21 make the release date human-friendly 483e9e2
2022-07-20 Update README.md (#57) 4051715
2022-07-18 Fix the tokenizer class (#53) e1d88ec
2022-07-18 Update README.md 373a962
2022-07-16 Fix language name 7fc8195
2022-07-13 Update README.md (#44) e965be3

Articles and coverage

9 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis9

kerkour.fr2019-06-05HN front pageHN 747 pts · 230 comments
github.comauthority5,453 words
The 176B parameter BLOOM model was trained on the Jean Zay supercomputer using 384 NVIDIA A100 GPUs and a Megatron-DeepSpeed stack. The system employed ZeRO sharding and pipeline parallelism to process 350B tokens of multilingual text over 3.5 months. Checkpoints stored bf16+fp32 weights totaling 2.3TB, while the model vocabulary size reached 250,680 tokens.written, reviewed, cited
  • Sequence parallelism was developed after BLOOM was trained so not used in the BLOOM training.
  • The compute was generously donated to the project by GENCI (grant 2021-A0101012475).
jmlr.org
surgehq.ai2,800 words
Hugging Face released BLOOM, a 176B parameter multilingual model trained by 1000+ researchers from 70+ countries. Human evaluation across seven categories revealed BLOOM struggles with zero-shot toxicity detection, where it misclassifies benign text like "i love you" as toxic, and creative writing, producing nonsensical continuations for romance and non-fiction prompts. While it passes some coding tasks, its real-world performance often falls short of what academic benchmarks suggest.written, reviewed, cited
paper-graph-ui.vercel.app
BLOOM is a 176B-parameter open-access multilingual model trained on the 1.61 TB ROOTS corpus that matches proprietary giants in performance while emitting only 25 tons of CO₂, roughly one-third of OPT-175B's emissions. The model achieves competent one-shot machine translation for high-resource pairs but collapses to near-zero BLEU for low-resource pairs like Swahili↔Yoruba due to severe data scarcity. Training required that 225 of the 498 component datasets remain inaccessible due to licensing or privacy constraints.written, reviewed, cited
  • The project required at least three fluent speakers to guide source selection for every language added to the corpus.
  • The 1.61 TB ROOTS corpus is substantially smaller than what could have been collected through indiscriminate crawling.
  • The model's zero-shot generalization performance was validated by finding that causal decoder-only models performed best immediately after pretraining.
softwarereviewreport.com2026-02-15
sh-tsang.medium.com2023-04-22
evandufraisse.github.io2024-01-19
paperium.net2025-12-01788 words

Papers

4 papers

Papers 4

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:37 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25

Follow bloom

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.