Models › opt family

facebook Other out 4 years ago

Text in, text out, 2K tokens of context.

Verified 2026-10-25 Rank #383 in LLMs · score 79.9 method v1 Sources 3 Downloads 30d 68k · #362 of 619 tracked

Can I use it?OtherCustom license; read the repo LICENSE before commercial hostinglicence file2026-10-24
Do people use it?68kdownloads, 30 days#362 of 619 we track · below the median+1 likes, downloads −3% this week189 likesHugging Face2026-10-24

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 15 quantized builds and 100 Spaces.

  • As a service0no API provider listed
  • On own hardware15quantized builds
  • Built on28062 fine-tunes · 218 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: openflamingo/OpenFlamingo ♥ 141 · tomg-group-umd/lm-watermarking ♥ 100 · nvidia/audio-flamingo-2 ♥ 38 · alvanlii/FROMAGe ♥ 27

The story so far

Weights, every dated article, and repo commits on one rail.

25 repo commits since the weights landed

Teal is the weights (2022-05-11), grey ticks are repo commits.

JunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2023-09-15: 1 repo commit2023-01-24: 1 repo commit2022-06-22: 1 repo commit2022-06-21: 1 repo commit2022-06-16: 1 repo commit2022-06-03: 6 repo commits2022-05-26: 1 repo commit2022-05-25: 1 repo commit2022-05-16: 2 repo commits2022-05-13: 2 repo commits2022-05-12: 6 repo commits2022-05-11: 2 repo commitsWeights 2022-05-11 · 2022-05-11Weights 2022-05-11now
JunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2023-09-15: 1 repo commit2023-01-24: 1 repo commit2022-06-22: 1 repo commit2022-06-21: 1 repo commit2022-06-16: 1 repo commit2022-06-03: 6 repo commits2022-05-26: 1 repo commit2022-05-25: 1 repo commit2022-05-16: 2 repo commits2022-05-13: 2 repo commits2022-05-12: 6 repo commits2022-05-11: 2 repo commitsWeights 2022-05-11 · 2022-05-11Weights 2022-05-11now

What people built on it

295 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

295 derivatives on the Hub, most of them adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

15 quantized (Hugging Face model tree)62 fine-tunes (Hugging Face model tree)218 adapters (Hugging Face model tree)15 quantized62 fine-tunes218 adapters
15 quantized (Hugging Face model tree)62 fine-tunes (Hugging Face model tree)218 adapters (Hugging Face model tree)15 quantized62 fine-tunes218 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

OPT-1.3b is a decoder-only transformer model designed for text generation tasks.[1]

  1. “decoder-only pre-trained transformers”

Generated 2026-10-07 15:09 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

1 use case

What it is good at 1 use case

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

18 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesOPTForCausalLM
Model typeopt
Dtypefloat16
MoEno
Context length2,048 (config.json max_position_embeddings)
Languagesen
PapersarXiv:2205.01068, arXiv:2005.14165
LicenseOther (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · OPTForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · OPTForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

All variants

40 variants

Lineage

Original model Family: facebook/opt 295 derivatives on the Hub

finetune: 62adapter: 218quantized: 15

Top variants (40 shown, ranked by downloads)

Relation
Quant
40 rows
Variant Relation Quant Params Band License Author Likes Downloads
MiniLLM/MiniLLM-OPT-1.3B finetune — — — apache-2.0 MiniLLM 1 1.4k
nicholasKluge/Aira-OPT-1B3 finetune — 1.32B S other nicholasKluge 0 1.4k
royokong/prompteol-opt-1.3b adapter — — — — royokong 1 675
MiniLLM/SFT-OPT-1.3B finetune — — — apache-2.0 MiniLLM 0 624
cj453/reward_modeling_anthropic_hh finetune — 331M S other cj453 0 467
ellen625/opt_2.7b_wiki_ce finetune — 1.32B S other ellen625 0 444
ellen625/opt_1.3b_wiki_k10 finetune — 1.32B S other ellen625 0 428
cj453/dense_reward_trainer_final_opt__NumTrainEpochs2_SaveStrategiesepoch_reward_modeling_anthropic_hh finetune — 1.42B S other cj453 0 398
MiniLLM/SeqKD-OPT-1.3B finetune — — — apache-2.0 MiniLLM 0 393
MiniLLM/KD-OPT-1.3B finetune — — — apache-2.0 MiniLLM 0 368
cj453/NumTrainEpochs10_SaveStrategiesno_reward_modeling_anthropic_hh finetune — 1.42B S other cj453 0 332
cj453/dense_reward_trainer_final_opt__NumTrainEpochs5_SaveStrategiesno_reward_modeling_anthropic_hh finetune — 1.42B S other cj453 0 324
MiniLLM/init-OPT-1.3B finetune — — — apache-2.0 MiniLLM 0 304
cj453/dense_reward_trainer_final_opt__NumTrainEpochs2_SaveStrategiesno_reward_modeling_anthropic_hh finetune — 1.42B S other cj453 0 303
cj453/dense_reward_trainer_final_opt__NumTrainEpochs5_SaveStrategiesepoch_reward_modeling_anthropic_hh finetune — 1.42B S other cj453 0 301
saking/alpaca adapter — — — other saking 0 278
varun-v-rao/opt-1.3b-squad-model2 finetune — 1.32B S other varun-v-rao 0 264
varun-v-rao/opt-1.3b-snli-model1 finetune — 1.32B S other varun-v-rao 0 250
varun-v-rao/opt-1.3b-lora-3.15M-snli-model1 finetune — 1.32B S other varun-v-rao 0 228
varun-v-rao/opt-1.3b-lora-3.15M-squad-model2 finetune — 1.32B S other varun-v-rao 0 221
texasdave2/opt-1.3b adapter — — — — texasdave2 0 163
prxy5608/125ec4bd-9fe4-4a1a-8e18-c7e938654165 adapter — — — other prxy5608 0 135
alitolga/627_facebook_opt-1.3b_P_Tuning adapter — — — — alitolga 0 134
Yehia3A/secure-policy-rewriter adapter — — — — Yehia3A 0 131
HeydarS/opt-1.3b-qlora adapter — — — — HeydarS 0 119
ksingh16/Bank_opt_1.3b_14 adapter — — — — ksingh16 0 106
iproskurina/opt-1.3b-GPTQ-4bit-g128 quantized GPTQ 373M S other iproskurina 0 99
marialvsantiago/3212a961-4d08-49b1-95ec-6c61ad5046c2 quantized — — — — marialvsantiago 0 97
JoshMe1/b2c13083-736a-446e-8954-1b9b7911df07 finetune — — — — JoshMe1 0 96
sergioalves/bdbdb386-405d-47ab-ae42-3799ef607bd5 quantized — — — — sergioalves 0 93
ospanbatyr/opt-1.3b-geoquery adapter — — — — ospanbatyr 0 89
A-hani/opt-1.3b-TunedByAbdullahAhsan adapter — — — — A-hani 1 39
TangTang3333/product-classification-model adapter — — — — TangTang3333 1 37
saking/network adapter — — — other saking 0 83
wz1114841863/opt-1.3b-bnb-4bit quantized -bnb 1.35B S other wz1114841863 0 82
ivangrapher/95eaa8af-249b-4609-b7ff-25402ed96cfc finetune — — — — ivangrapher 0 82
vermoney/3665f01b-09d2-471e-98bd-ed162a64ba1f quantized — — — — vermoney 0 80
cpheemagazine/5e217039-ab82-4f18-b7cb-3123284090be finetune — — — — cpheemagazine 0 74
tarabukinivanhome/f522ade8-be03-42e5-a534-4b6b234b59b4 finetune — — — — tarabukinivanhome 0 74
lostargon/opt-11b_PROMPT_TUNING_CAUSAL_LM_LR adapter — — — — lostargon 0 72

Repository changelog

25 commits

Repository changelog 25 commits

DateCommitSHA
2023-09-15 Update README.md (#28) 3f5c25d
2023-01-24 Adding generation config file(s) 8c7b107
2022-06-22 Update README.md (#6) aa6ac1e
2022-06-21 correct checkpoints see: https://github.com/facebookresearch/metaseq/pull/164 e8c4fe5
2022-06-16 Update TF weights (#3) c8fd423
2022-06-03 Add flax_weights f39e497
2022-06-03 Add tf_weights cff2d3d
2022-06-03 Revert config modifications bf21b09
2022-06-03 Update README.md 5ede9d0
2022-06-03 add model 6a853c0
2022-06-03 add model b45c935
2022-05-26 Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (#1) 80fcb57
2022-05-25 Update tokenizer_config.json fdb6055
2022-05-16 Set commercial attribute to False f141145
2022-05-16 Update README d2f35d5
2022-05-13 Temporarily deactivate the inference API 53f0416
2022-05-13 Update config.json cf57a76
2022-05-12 Update README.md 337a855
2022-05-12 Update README.md 7a0f2c1
2022-05-12 Update README.md 60a8187
2022-05-12 Create README.md c71c648
2022-05-12 finish c57bfbf
2022-05-12 Update config.json 75cb04a
2022-05-11 add model 4c77920
2022-05-11 initial commit 06c8705

Papers

2 papers

Papers 2

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:38 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:09 UTC · Last verified 2026-10-25

Follow opt-1.3b

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.