Models › falcon family

falcon-40b-instruct

tiiuae Apache 2.0 out 3 years ago

Text in, text out.

Verified 2026-10-25 Rank #356 in LLMs · score 81.2 method v1 Sources 3 Downloads 30d 1.8k · #581 of 619 tracked

Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?1.8kdownloads, 30 days#581 of 619 we track · below the median+2 likes, downloads −49% this week1,185 likesHugging Face2026-10-24

Worth reading

Picked by rule from 13 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 2 years ago

Falcon 2

On 13 May, 2024, the Technology Innovation Institute released Falcon 2, an open-source model series where Falcon 2 11B scores 64.28 on the Hugging Face leaderboard, narrowly trailing Google's Gemma 7B at 64.29.

  • Falcon 2 11B VLM is the only current top-tier market model with image-to-text conversion capability.
  • Future Falcon 2 models will incorporate Mixture of Experts to amalgamate smaller networks with distinct specializations.
tii.ae 2024-05-13 225 HN pts · 108 comments 822 words about the falcon family family

13 best of 13 tracked

The 3 picks above, plus these 10. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleFalcon 180Bhuggingface.co · 2023-09-06
  2. CodeFalcon is a free, open-source SQL editor with inline data visualizationgithub.com · 2020-04-15 · 604 HN pts
  3. DiscussionFalcon 40B LLM (which beats Llama) now Apache 2.0twitter.com · 2023-05-31 · 435 HN pts
  4. ArticleThe Falcon has landed in the Hugging Face ecosystemhuggingface.co · 2023-06-05
  5. Articlehttps://datacamp.com/tutorial/introduction-to-falcon-40bdatacamp.com · undated
  6. ArticleFalcon 40B Instruct — Hardware Requirements & Compatibility | llmrunllmrun.dev · undated
  7. ArticleFalcon 40B — Specs, Pricing & GPU Requirements | InferenceBench | InferenceBenchinferencebench.io · undated
  8. ArticleGuides for Running Falcon-40B (Base, Instruct, Uncensored) on GPU Cloudsgpus.llm-utils.org · 2023-07-14 · 2 HN pts
  9. ArticleBenchmarking Falcon-40B-Instruct: Latency, Cost, and RPS Evaluationtruefoundry.com · 2023-10-06
  10. ArticleMediummedium.com · 2023-06-08

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 2 quantized builds and 90 Spaces.

  • As a service0no API provider listed
  • On own hardware2quantized builds
  • Built on63 fine-tunes · 3 adapters · 0 merges
  • In apps90Hugging Face Spaces

Top Spaces running it: Vokturz/can-it-run-llm ♥ 1,053 · HuggingFaceH4/falcon-chat ♥ 557 · h2oai/h2ogpt-chatbot ♥ 295 · h2oai/h2ogpt-chatbot2 ♥ 167

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2023-05-25), amber triangles are 6 dated articles (each links to it), grey ticks are repo commits.

MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2023-09-29: 1 repo commit2023-07-13: 1 repo commit2023-07-12: 1 repo commit2023-06-09: 2 repo commits2023-06-05: 2 repo commits2023-05-31: 3 repo commits2023-05-30: 4 repo commits2023-05-26: 2 repo commits2023-05-25: 4 repo commitsFalcon is a free, open-source SQL editor with inline data visualization · 2020-04-15Falcon 2 · 2024-05-13A 1/48 scale model of the SpaceX Falcon Heavy rocket · 2020-05-31Falcon 40B LLM (which beats Llama) now Apache 2.0 · 2023-05-31The Falcon has landed in the Hugging Face ecosystem · 2023-06-05Guides for Running Falcon-40B (Base, Instruct, Uncensored) on GPU Clouds · 2023-07-14Weights 2023-05-25 · 2023-05-25Weights 2023-05-25now
MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2023-09-29: 1 repo commit2023-07-13: 1 repo commit2023-07-12: 1 repo commit2023-06-09: 2 repo commits2023-06-05: 2 repo commits2023-05-31: 3 repo commits2023-05-30: 4 repo commits2023-05-26: 2 repo commits2023-05-25: 4 repo commitsFalcon is a free, open-source SQL editor with inline data visualization · 2020-04-15Falcon 2 · 2024-05-13A 1/48 scale model of the SpaceX Falcon Heavy rocket · 2020-05-31Falcon 40B LLM (which beats Llama) now Apache 2.0 · 2023-05-31The Falcon has landed in the Hugging Face ecosystem · 2023-06-05Guides for Running Falcon-40B (Base, Instruct, Uncensored) on GPU Clouds · 2023-07-14Weights 2023-05-25 · 2023-05-25Weights 2023-05-25now

What people built on it

8 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

8 derivatives on the Hub, led by 3 fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

2 quantized (Hugging Face model tree)3 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)2 quantized3 fine-tunes3 adapters
2 quantized (Hugging Face model tree)3 fine-tunes (Hugging Face model tree)3 adapters (Hugging Face model tree)2 quantized3 fine-tunes3 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Falcon-40B-Instruct is a 40B parameters causal decoder-only model developed by TII for text generation.[1][2] The model is finetuned on a mixture of Baize and is released under the Apache 2.0 license.[3][4]

  1. “40B parameters causal decoder-only model”
  2. pipeline tag
  3. “finetuned on a mixture of Baize”
  4. license

Generated 2026-10-07 15:08 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

15 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesFalconForCausalLM
Model typefalcon
Dtypebfloat16
MoEno
Languagesen
PapersarXiv:2205.14135, arXiv:1911.02150, arXiv:2005.14165, arXiv:2104.09864, arXiv:2306.01116, arXiv:2304.01196
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · FalconForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · FalconForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

All variants

8 variants

Lineage

Original model Family: tiiuae/falcon 8 derivatives on the Hub

quantized: 2adapter: 3finetune: 3

Top variants (8 shown, ranked by downloads)

Relation
8 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/falcon-40b-instruct-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 1 24.1k
mradermacher/falcon-40b-instruct-GGUF quantized GGUF — — apache-2.0 mradermacher 0 13.6k
mubashirsaeed/care-bot-harry-potter-falcon-40b adapter — — — — mubashirsaeed 0 83
anirudh2403/results finetune — — — apache-2.0 anirudh2403 0 43
raulgdp/falcon-40b-instruct-009 adapter — — — apache-2.0 raulgdp 0 30
Shishir17/falcon40binstruct_mentalhealthmodel_oct23 adapter — — — apache-2.0 Shishir17 0 25
lucas0/empath-falcon-40b finetune — — — apache-2.0 lucas0 0 0
miragexy/ins_fine_tuned_falcon40B finetune — — — — miragexy 0 0

Repository changelog

20 commits

Repository changelog 20 commits

DateCommitSHA
2023-09-29 Move to in-library model (for real this time) (#86) ecb78d9
2023-07-13 Revert in-library PR (#67) ca78eac
2023-07-12 Move to in-library checkpoint (#60) 7475ff8
2023-06-09 Update README.md: Update Model Description to reference Falcon-40B as the base model for falcon-40b-instruct (#17) 1e7fdcc
2023-06-09 Add usage recommendations 6f1c467
2023-06-05 Update citation info 4e8f82c
2023-06-05 Add hf endpoint handler.py (#30) b55d7ec
2023-05-31 Remove TII Falcon LLM license 5b94094
2023-05-31 Update license information to Apache 2.0 7205e7e
2023-05-31 Update README.md (#10) 8fac8c1
2023-05-30 license: tii-falcon-llm (#5) 93e2373
2023-05-30 Update config.json 662a9a4
2023-05-30 Update README.md de92598
2023-05-30 Update modelling_RW.py 357dc3f
2023-05-26 Add model card 38377d0
2023-05-26 Add license 74aef5b
2023-05-25 Update modelling_RW.py 74e0515
2023-05-25 Upload tokenizer 7a666cb
2023-05-25 Upload RWForCausalLM e22aa38
2023-05-25 initial commit 61aa3b4

Articles and coverage

13 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

tii.ae2024-05-13officialHN front pageabout the falcon familyHN 225 pts · 108 comments822 words
On 13 May, 2024, the Technology Innovation Institute released Falcon 2, an open-source model series where Falcon 2 11B scores 64.28 on the Hugging Face leaderboard, narrowly trailing Google's Gemma 7B at 64.29. The 11B variant is trained on 5.5 trillion tokens and licensed under Falcon License 2.0, while the Falcon 2 11B VLM adds vision-to-language capabilities for image-to-text conversion. Both models run efficiently on a single GPU and support multiple languages including English, French, and Spanish.written, reviewed, cited
  • Falcon 2 11B VLM is the only current top-tier market model with image-to-text conversion capability.
  • Future Falcon 2 models will incorporate Mixture of Experts to amalgamate smaller networks with distinct specializations.
  • The Falcon License 2.0 includes an acceptable use policy that promotes the responsible use of AI.

Analysis8

github.com2020-04-15authorityHN front pageabout the falcon familyHN 604 pts · 84 comments300 words
Falcon is a free, open-source SQL editor for Windows and Mac that includes inline data visualization. Built with Electron, React, Redux, and Sequelize, it connects to databases like RedShift, MySQL, and PostgreSQL without requiring an internet connection or a Plotly Chart Studio account. The code is released under the MIT License.written, reviewed, cited
bps.space2020-05-31HN front pageabout the falcon familyHN 820 pts · 94 comments
huggingface.co2023-06-05authorityabout the falcon family2,442 words
madebyagents.com1,874 words
datacamp.com
llmrun.dev1,313 words
inferencebench.io613 words
gpus.llm-utils.org2023-07-14HN 2 pts · 1 comments1,629 words

Community1

twitter.com2023-05-31HN front pageHN 435 pts · 141 comments
All coverage tracked for this model (13) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Falcon 40B Instruct | Reference Models | Made By Agentsmadebyagents.com—2026-10-14exa
https://datacamp.com/tutorial/introduction-to-falcon-40bdatacamp.com—2026-10-14exa
Falcon 40B Instruct — Hardware Requirements & Compatibility | llmrunllmrun.dev—2026-10-14exa
Falcon 40B — Specs, Pricing & GPU Requirements | InferenceBench | InferenceBenchinferencebench.io—2026-10-14exa
Falcon 2tii.ae official2024-05-132026-10-07hn
Benchmarking Falcon-40B-Instruct: Latency, Cost, and RPS Evaluationtruefoundry.com2023-10-062026-10-14exa
Falcon 180Bhuggingface.co2023-09-062026-10-07hn
Guides for Running Falcon-40B (Base, Instruct, Uncensored) on GPU Cloudsgpus.llm-utils.org2023-07-142026-10-07hn
Mediummedium.com2023-06-082026-10-14exa
The Falcon has landed in the Hugging Face ecosystemhuggingface.co2023-06-052026-10-14exa
Falcon 40B LLM (which beats Llama) now Apache 2.0twitter.com2023-05-312026-10-07hn
A 1/48 scale model of the SpaceX Falcon Heavy rocketbps.space2020-05-312026-10-07hn
Falcon is a free, open-source SQL editor with inline data visualizationgithub.com2020-04-152026-10-07hn

Papers

6 papers

Papers 6

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • opt-125m
    same task (text-generation)
  • gpt-j-6b
    same task (text-generation), permissive license
  • DialoGPT-medium
    same task (text-generation), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:38 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:08 UTC · Last verified 2026-10-25

Follow falcon-40b-instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.