Models › falcon family

tiiuae Apache 2.0 out 4 years ago

7.22B parameters, text in, text out.

Verified 2026-10-25 Rank #187 in LLMs · score 89.7 method v1 Sources 3 Downloads 30d 189.8k · #254 of 619 tracked

Can I run it?4.3GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?189.8kdownloads, 30 days#254 of 619 we track · top 41%+2 likes, downloads −26% this week1,116 likesHugging Face2026-10-24

Worth reading and watching

Picked by rule from 20 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 2 years ago

Falcon 2

On 13 May, 2024, the Technology Innovation Institute released Falcon 2, an open-source model series where Falcon 2 11B scores 64.28 on the Hugging Face leaderboard, narrowly trailing Google's Gemma 7B at 64.29.

  • Falcon 2 11B VLM is the only current top-tier market model with image-to-text conversion capability.
  • Future Falcon 2 models will incorporate Mixture of Experts to amalgamate smaller networks with distinct specializations.
tii.ae 2024-05-13 225 HN pts · 108 comments 822 words about the falcon family family

20 best of 20 tracked

The 3 picks above, plus these 17. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. ArticleFalcon 180Bhuggingface.co · 2023-09-06
  2. CodeFalcon is a free, open-source SQL editor with inline data visualizationgithub.com · 2020-04-15 · 604 HN pts
  3. DiscussionFalcon 40B LLM (which beats Llama) now Apache 2.0twitter.com · 2023-05-31
  4. CodeFinetuning of Falcon-7B LLM Using QLoRA on Mental Health Conversational Datasetgithub.com · 2023-08-06 · 160 HN pts
  5. Codefalcon.mdgithub.com · undated
  6. ArticleFalcon H1R 7Bhuggingface.co · 2026-01-05 · 2 HN pts
  7. VideoFalcon 7B running real time on CPUyoutube.com · 2023-07-05 · 11 HN pts
  8. DiscussionFine Tuning Falcon 7B to be a ChatBotold.reddit.com · 2023-06-26 · 11 HN pts
  9. ArticleFalcon 7B — Hardware Requirements & Compatibility | llmrunllmrun.dev · undated
  10. ArticleFalcon 7B — Inference Specs & Pricing | InferenceBenchinferencebench.io · undated
  11. ArticleDeploy Falcon-7B with NVIDIA TensorRT-LLM on OCI | ai-and-datascienceblogs.oracle.com · undated
  12. DiscussionFalcon 7B running on Mac with Core ML at ~4.3 tokens per secondtwitter.com · 2023-06-04
  13. ArticleFalcon-H1R: Hybrid Model for Efficient Test-Time Scalingfalcon-lm.github.io · 2026-01-05
  14. ArticleFalcon Mamba 7B's powerful new AI architecture offers alternative to transformerventurebeat.com · 2024-08-13
  15. ArticleShow HN: Leverage Falcon 7B blog postmedium.com · 2023-09-09
  16. ArticleMediummedium.com · 2023-06-08
  17. ArticleFalcon-7B — benchmarks, pricing & hardware fit · Model Beatsmodelbeats.com · 2023-05-25

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 13 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware13quantized builds
  • Built on33647 fine-tunes · 289 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: pliny-the-prompter/obliteratus ♥ 621 · h2oai/h2ogpt-chatbot ♥ 295 · h2oai/h2ogpt-chatbot2 ♥ 167 · tomg-group-umd/Binoculars ♥ 76

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.3 GB at INT4, 8.7 GB at FP8, 17 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.3 GB of weights (estimate; KV cache and activations extra)INT44.3 GBFP8: about 8.7 GB of weights (estimate; KV cache and activations extra)FP88.7 GBBF16: about 17 GB of weights (estimate; KV cache and activations extra)BF1617 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.3 GB of weights (estimate; KV cache and activations extra)INT44.3 GBFP8: about 8.7 GB of weights (estimate; KV cache and activations extra)FP88.7 GBBF16: about 17 GB of weights (estimate; KV cache and activations extra)BF1617 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

8 dated articles and 30 repo commits so far

Teal is the weights (2023-04-24), amber triangles are 8 dated articles (each links to it), grey ticks are repo commits.

MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2024-10-12: 1 repo commit2024-09-28: 1 repo commit2023-09-29: 1 repo commit2023-08-30: 1 repo commit2023-07-13: 1 repo commit2023-07-12: 1 repo commit2023-06-09: 2 repo commits2023-06-05: 2 repo commits2023-05-31: 4 repo commits2023-05-30: 4 repo commits2023-05-26: 4 repo commits2023-05-25: 3 repo commits2023-05-24: 2 repo commits2023-04-24: 3 repo commitsFalcon is a free, open-source SQL editor with inline data visualization · 2020-04-15Falcon 2 · 2024-05-13A 1/48 scale model of the SpaceX Falcon Heavy rocket · 2020-05-31Finetuning of Falcon-7B LLM Using QLoRA on Mental Health Conversational Dataset · 2023-08-06Falcon H1R 7B · 2026-01-05Falcon 7B running real time on CPU · 2023-07-05Fine Tuning Falcon 7B to be a ChatBot · 2023-06-26Abu Dhabi's TTI releases open-source Falcon-7B and -40B LLMs · 2023-05-26Weights 2023-04-24 · 2023-04-24Weights 2023-04-24now
MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2024-10-12: 1 repo commit2024-09-28: 1 repo commit2023-09-29: 1 repo commit2023-08-30: 1 repo commit2023-07-13: 1 repo commit2023-07-12: 1 repo commit2023-06-09: 2 repo commits2023-06-05: 2 repo commits2023-05-31: 4 repo commits2023-05-30: 4 repo commits2023-05-26: 4 repo commits2023-05-25: 3 repo commits2023-05-24: 2 repo commits2023-04-24: 3 repo commitsFalcon is a free, open-source SQL editor with inline data visualization · 2020-04-15Falcon 2 · 2024-05-13A 1/48 scale model of the SpaceX Falcon Heavy rocket · 2020-05-31Finetuning of Falcon-7B LLM Using QLoRA on Mental Health Conversational Dataset · 2023-08-06Falcon H1R 7B · 2026-01-05Falcon 7B running real time on CPU · 2023-07-05Fine Tuning Falcon 7B to be a ChatBot · 2023-06-26Abu Dhabi's TTI releases open-source Falcon-7B and -40B LLMs · 2023-05-26Weights 2023-04-24 · 2023-04-24Weights 2023-04-24now

What people built on it

349 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

349 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

13 quantized (Hugging Face model tree)47 fine-tunes (Hugging Face model tree)289 adapters (Hugging Face model tree)13 quantized47 fine-tunes289 adapters
13 quantized (Hugging Face model tree)47 fine-tunes (Hugging Face model tree)289 adapters (Hugging Face model tree)13 quantized47 fine-tunes289 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

18 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesFalconForCausalLM
Model typefalcon
Dtypebfloat16
Params by dtypeBF16: 7,217,189,760
Size bandM
MoEno
Languagesen
PapersarXiv:2205.14135, arXiv:1911.02150, arXiv:2101.00027, arXiv:2005.14165, arXiv:2104.09864, arXiv:2306.01116
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · FalconForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · FalconForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for falcon-7b: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)17 GB · Single GPU (<24 GB)
FP8 (1 byte/param)8.7 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.3 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

40 variants

Lineage

Original model Family: tiiuae/falcon 349 derivatives on the Hub

finetune: 47quantized: 13adapter: 289

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
OpenLLM-France/Claire-7B-0.1 finetune — 6.92B M cc-by-nc-sa-4.0 OpenLLM-France 47 9k
maddes8cht/OpenLLM-France-Claire-7B-0.1-gguf quantized gguf — — cc-by-nc-sa-4.0 maddes8cht 1 8.4k
dfurman/Falcon-7B-Chat-v0.1 adapter — — — apache-2.0 dfurman 43 2.6k
mradermacher/falcon-7b-i1-GGUF quantized GGUF — — apache-2.0 mradermacher 0 4.4k
tensorblock/falcon-7b-GGUF quantized GGUF — — apache-2.0 tensorblock 0 3.6k
polyverse/falcon-7b-Q5_K_M-GGUF quantized GGUF — — apache-2.0 polyverse 1 2.1k
mradermacher/falcon-7b-GGUF quantized GGUF — — apache-2.0 mradermacher 0 2k
Sandiago21/falcon-7b-prompt-answering quantized — — — other Sandiago21 2 1.3k
monsterapi/falcon_7b_3epoch_norobots adapter — — — apache-2.0 monsterapi 1 1.1k
heliosbrahma/falcon-7b-sharded-bf16-finetuned-mental-health-conversational finetune -bf16 — — mit heliosbrahma 7 807
BlackUnicornSec/Basileak adapter GGUF 6.92B M apache-2.0 BlackUnicornSec 3 798
DevQuasar-6/tiiuae.falcon-7b-GGUF quantized GGUF — — — DevQuasar-6 0 943
OpenLLM-France/Claire-7B-Apache-0.1 finetune — — — apache-2.0 OpenLLM-France 7 586
bnsapa/faq-llm adapter — — — — bnsapa 0 917
polyverse/falcon-7b-Q4_K_M-GGUF quantized GGUF — — apache-2.0 polyverse 1 567
kaetemi/falcon-7b-Q4_0-GGUF quantized Q4_0 — — apache-2.0 kaetemi 0 558
Menouar/falcon7b-linear-equations adapter — — — apache-2.0 Menouar 1 497
OpenLLM-France/Claire-7B-EN-0.1 finetune — 6.92B M cc-by-nc-sa-4.0 OpenLLM-France 1 496
BramVanroy/falcon-7b-ft-mc4_nl_cleaned_tiny finetune — 6.92B M apache-2.0 BramVanroy 0 545
hipnologo/falcon-7b-qlora-finetune-chatbot adapter — — — apache-2.0 hipnologo 1 455
monsterapi/falcon_7b_DolphinCoder adapter — — — apache-2.0 monsterapi 0 399
monsterapi/falcon_7b_norobots adapter — — — apache-2.0 monsterapi 2 298
itsmomo300/falcon-7b-sharded-bf16-finetuned-mental-health-conversational adapter -bf16 — — apache-2.0 itsmomo300 0 379
UrFavB0i/Fine-tuned-Falcon7B-skincare-chatbot finetune — 6.92B M apache-2.0 UrFavB0i 1 316
Mastane/falcon-7b-sft-lora finetune — — — apache-2.0 Mastane 1 305
Mastane/falcon-7b-dpo-lora finetune — — — apache-2.0 Mastane 1 305
dawveed/AWS-Sage adapter — — — apache-2.0 dawveed 3 185
pmysl/falcon-7b-alpaca-pl-qlora adapter — — — apache-2.0 pmysl 1 260
ck46/falcon-7b-math-geometry-lora adapter — — — — ck46 1 259
microsoft/falcon-7B-onnx quantized — — — apache-2.0 microsoft 6 0
sasuface/mechanic-falcon-7b adapter — — — — sasuface 3 150
EnDevSols/falcon-7b-chat-icd adapter — — — — EnDevSols 1 224
monsterapi/falcon-7b-python-code-instructions-18k-alpaca adapter — — — apache-2.0 monsterapi 1 204
chathuru/cicids2018-falcon7b finetune — — — apache-2.0 chathuru 0 237
pkarypis/falcon-lima finetune — 6.92B M apache-2.0 pkarypis 0 224
kaetemi/falcon-7b-Q8_0-GGUF quantized Q8_0 — — apache-2.0 kaetemi 0 217
TopperThijs/Falcon-narration-10-15 adapter — — — apache-2.0 TopperThijs 0 198
ck46/falcon-7b-math-lora adapter — — — — ck46 1 144
devajsanghvi15/genAI-project finetune — — — mit devajsanghvi15 0 190
ck46/falcon-7b-math-algebra-lora adapter — — — — ck46 1 135

Repository changelog

30 commits

Repository changelog 30 commits

DateCommitSHA
2024-10-12 Adding `safetensors` variant of this model (#106) ec89142
2024-09-28 enh: add link to updated model 545fd35
2023-09-29 Move to in-library checkpoint (for real this time) (#84) 898df13
2023-08-30 Update README.md f779652
2023-07-13 Revert in-library PR (#66) 3783374
2023-07-12 Move to in-library checkpoint (#57) 4e2d06f
2023-06-09 Update README.md (#19) 2f5c3cd
2023-06-09 Add recommendations for inference and finetuning 7327008
2023-06-05 Update citation info a0395a0
2023-06-05 Update metadata f6d4744
2023-05-31 Remove TII Falcon LLM license da8d49a
2023-05-31 Update license info to Apache 2.0 21be553
2023-05-31 `license: apache-2.0` (#15) d743f4b
2023-05-31 Register all auto classes (#12) 2e35869
2023-05-30 license: tii-falcon-llm 87c4c0d
2023-05-30 Update config.json f3185ff
2023-05-30 Update modelling_RW.py 1ba2370
2023-05-30 Update README.md (#1) ccbff8f
2023-05-26 Add PyTorch 2.0 notice 308ced2
2023-05-26 Add link to RefinedWeb 650217d
2023-05-26 Fix typo c1a49e6
2023-05-26 Update model card 591607b
2023-05-25 Create README.md 555b780
2023-05-25 Create LICENSE.txt 15f1e0e
2023-05-25 Update modelling_RW.py 552521c
2023-05-24 Upload tokenizer b65214c
2023-05-24 Update modelling_RW.py 854fab6
2023-04-24 Upload RWForCausalLM 9562025
2023-04-24 Upload RWForCausalLM 80b61a6
2023-04-24 initial commit a76587e

Articles and coverage

20 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official2

tii.ae2024-05-13officialHN front pageabout the falcon familyHN 225 pts · 108 comments822 words
On 13 May, 2024, the Technology Innovation Institute released Falcon 2, an open-source model series where Falcon 2 11B scores 64.28 on the Hugging Face leaderboard, narrowly trailing Google's Gemma 7B at 64.29. The 11B variant is trained on 5.5 trillion tokens and licensed under Falcon License 2.0, while the Falcon 2 11B VLM adds vision-to-language capabilities for image-to-text conversion. Both models run efficiently on a single GPU and support multiple languages including English, French, and Spanish.written, reviewed, cited
  • Falcon 2 11B VLM is the only current top-tier market model with image-to-text conversion capability.
  • Future Falcon 2 models will incorporate Mixture of Experts to amalgamate smaller networks with distinct specializations.
  • The Falcon License 2.0 includes an acceptable use policy that promotes the responsible use of AI.
tii.ae2023-05-26officialHN 2 pts · 2 comments801 words

Analysis7

github.com2020-04-15authorityHN front pageabout the falcon familyHN 604 pts · 84 comments300 words
Falcon is a free, open-source SQL editor for Windows and Mac that includes inline data visualization. Built with Electron, React, Redux, and Sequelize, it connects to databases like RedShift, MySQL, and PostgreSQL without requiring an internet connection or a Plotly Chart Studio account. The code is released under the MIT License.written, reviewed, cited
bps.space2020-05-31HN front pageabout the falcon familyHN 820 pts · 94 comments
github.com2023-08-06authorityHN front pageHN 160 pts · 108 comments592 words
github.comauthorityabout the falcon family2,494 words
huggingface.co2026-01-05authorityabout the falcon familyHN 2 pts · 0 comments1,313 words
youtube.com2023-07-05HN 11 pts · 3 comments
llmrun.dev

Community1

old.reddit.com2023-06-26HN 11 pts · 2 comments
All coverage tracked for this model (20) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
falcon.mdgithub.com—2026-10-07exa
Falcon 7B — Hardware Requirements & Compatibility | llmrunllmrun.dev—2026-10-07exa
Falcon 7B — Inference Specs & Pricing | InferenceBenchinferencebench.io—2026-10-07exa
Deploy Falcon-7B with NVIDIA TensorRT-LLM on OCI | ai-and-datascienceblogs.oracle.com—2026-10-07exa
Falcon H1R 7Bhuggingface.co2026-01-052026-10-07hn, exa
Falcon-H1R: Hybrid Model for Efficient Test-Time Scalingfalcon-lm.github.io2026-01-052026-10-07hn
Falcon Mamba 7B's powerful new AI architecture offers alternative to transformerventurebeat.com2024-08-132026-10-07hn
Falcon 2tii.ae official2024-05-132026-10-07hn
Show HN: Leverage Falcon 7B blog postmedium.com2023-09-092026-10-07hn
Falcon 180Bhuggingface.co2023-09-062026-10-07hn
Finetuning of Falcon-7B LLM Using QLoRA on Mental Health Conversational Datasetgithub.com2023-08-062026-10-07hn
Falcon 7B running real time on CPUyoutube.com2023-07-052026-10-07hn
Fine Tuning Falcon 7B to be a ChatBotold.reddit.com2023-06-262026-10-07hn
Mediummedium.com2023-06-082026-10-07exa
Falcon 7B running on Mac with Core ML at ~4.3 tokens per secondtwitter.com2023-06-042026-10-07hn
Falcon 40B LLM (which beats Llama) now Apache 2.0twitter.com2023-05-312026-10-07hn
Abu Dhabi's TTI releases open-source Falcon-7B and -40B LLMstii.ae official2023-05-262026-10-07hn
Falcon-7B — benchmarks, pricing & hardware fit · Model Beatsmodelbeats.com2023-05-252026-10-07exa
A 1/48 scale model of the SpaceX Falcon Heavy rocketbps.space2020-05-312026-10-07hn
Falcon is a free, open-source SQL editor with inline data visualizationgithub.com2020-04-152026-10-07hn

Papers

6 papers

Papers 6

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-7B-Instruct · 7.62B
    same size band (M), same task (text-generation), more providers, permissive license
  • Mistral-7B-Instruct-v0.2 · 7.24B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25

Follow falcon-7b

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.