Models › EXAONE-3.0 family

EXAONE-3.0-7.8B-Instruct

LGAI-EXAONE exaone out 2 years ago

7.82B parameters, text in, text out.

Verified 2026-10-25 Rank #750 in LLMs · score 71.5 method v1 Sources 3 Downloads 30d 14.6k · #480 of 619 tracked

Can I run it?4.7GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?exaoneCustom license; read the repo LICENSE before commercial hostinglicence file2026-10-24
Do people use it?14.6kdownloads, 30 days#480 of 619 we track · below the median424 likesHugging Face2026-10-24

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 9 quantized builds and 14 Spaces.

  • As a service0no API provider listed
  • On own hardware9quantized builds
  • Built on84 fine-tunes · 4 adapters · 0 merges
  • In apps14Hugging Face Spaces

Top Spaces running it: Steven10429/apply_lora_and_quantize ♥ 2 · ArthurZ/transformers-triage ♥ 1

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 4.7 GB at INT4, 9.4 GB at FP8, 19 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.7 GB of weights (estimate; KV cache and activations extra)INT44.7 GBFP8: about 9.4 GB of weights (estimate; KV cache and activations extra)FP89.4 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 4.7 GB of weights (estimate; KV cache and activations extra)INT44.7 GBFP8: about 9.4 GB of weights (estimate; KV cache and activations extra)FP89.4 GBBF16: about 19 GB of weights (estimate; KV cache and activations extra)BF1619 GB

Estimate params × bytes per param × 1.2 · how we estimate

What people built on it

17 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

17 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

9 quantized (Hugging Face model tree)4 fine-tunes (Hugging Face model tree)4 adapters (Hugging Face model tree)9 quantized4 fine-tunes4 adapters
9 quantized (Hugging Face model tree)4 fine-tunes (Hugging Face model tree)4 adapters (Hugging Face model tree)9 quantized4 fine-tunes4 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

16 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesExaoneForCausalLM
Model typeexaone
Params by dtypeF32: 7,818,448,896
Size bandM
MoEno
Gatedauto
PapersarXiv:2408.03541
Licenseexaone (other)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · ExaoneForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · ExaoneForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for EXAONE-3.0-7.8B-Instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)19 GB · Single GPU (<24 GB)
FP8 (1 byte/param)9.4 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)4.7 GB · Single GPU (<24 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

17 variants

Lineage

Original model Family: LGAI-EXAONE/EXAONE-3.0 17 derivatives on the Hub

quantized: 9adapter: 4finetune: 4

Top variants (17 shown, ranked by downloads)

Relation
17 rows
Variant Relation Quant Params Band License Author Likes Downloads
bartowski/EXAONE-3.0-7.8B-Instruct-GGUF quantized GGUF — — other bartowski 9 29k
mradermacher/EXAONE-3.0-7.8B-Instruct-i1-GGUF quantized GGUF — — other mradermacher 0 8.4k
second-state/EXAONE-3.0-7.8B-Instruct-GGUF quantized GGUF — — other second-state 1 6.9k
mradermacher/EXAONE-3.0-7.8B-Instruct-GGUF quantized GGUF — — other mradermacher 0 3.6k
gaianet/EXAONE-3.0-7.8B-Instruct-GGUF quantized GGUF — — other gaianet 0 3.3k
DevQuasar-3/LGAI-EXAONE.EXAONE-3.0-7.8B-Instruct-GGUF quantized GGUF — — — DevQuasar-3 1 2k
swchoi1994/exaone3.0-8b-gguf quantized gguf — — apache-2.0 swchoi1994 0 655
itlwas/EXAONE-3.0-7.8B-Instruct-Q4_K_M-GGUF quantized GGUF — — other itlwas 0 376
Toastmachine/exaone_CSAT_test adapter — — — other Toastmachine 0 68
hmlee/exaone_pruned finetune — 6.40B M — hmlee 1 1
yoyomo/exaone_mental_pretrained finetune — 7.82B M other yoyomo 0 48
Roseshmay/led-qa-exaone-3.0-7.8b-lora adapter — — — — Roseshmay 0 36
Toastmachine/exaone_CSAT_ORPO adapter — — — other Toastmachine 0 13
hmlee/exaone_prune_sft finetune — 6.40B M — hmlee 0 1
hmlee/exaone_prune_sftv4_int4 quantized — 6.40B M — hmlee 0 1
heongjun127/results finetune — — — — heongjun127 0 0
LINKER98/CareerBoostAI adapter — 7.82B M other LINKER98 0 0

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Llama-3.1-8B-Instruct · 8.03B
    same size band (M), same task (text-generation), more providers
  • Qwen2.5-7B-Instruct · 7.62B
    same size band (M), same task (text-generation), more providers, permissive license
  • Qwen3-8B · 8.19B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:42 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:14 UTC · Last verified 2026-10-25

Follow EXAONE-3.0-7.8B-Instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.