Up to date
NousResearch Llama 3 Community License out 2 years ago
70.6B parameters, text in, text out, 128K tokens of context. 2 providers serve it from $0.70 per million input tokens.
Verified 2026-10-25 Rank #665 in LLMs · score 72.8 method v1 Sources 4 Downloads 30d 2.1k · #576 of 619 tracked
Picked by rule from 4 tracked pieces: the lab's own post, the most shared, a field report, the latest.
Nous Research launched Hermes 3, the first full-parameter fine-tune of Meta's Llama 3.1 405B model, trained on an 8-node Lambda 1-Click Cluster.
The 2 picks above, plus these 2. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
Served by 2 API providers; 11 quantized builds for local use.
Top Spaces running it: Nymbo/overthink-1 ♥ 35 · wenbopan/overthink-1 ♥ 11 · ABABA-23/uncensored-chatbot ♥ 9 · hacktogone/uncensored-chat ♥ 6
Weights only, an estimate: leave room for the KV cache. Method
About 42 GB at INT4, 85 GB at FP8, 169 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2024-07-29), amber triangles are 4 dated articles (each links to it), grey ticks are repo commits.
42 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | text-generation |
|---|---|
| Library | transformers |
| Architectures | LlamaForCausalLM |
| Model type | llama |
| Dtype | bfloat16 |
| Params by dtype | BF16: 70,553,706,496 |
| Size band | XL |
| MoE | no |
| Context length | 131,072 (config.json max_position_embeddings) |
| Languages | en |
| Papers | arXiv:2408.11857 |
| License | Llama 3 Community License (llama3) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · LlamaForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · LlamaForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for Hermes-3-Llama-3.1-70B: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 169 GB · Multi-GPU node (<640 GB) |
|---|---|
| FP8 (1 byte/param) | 85 GB · Multi-GPU node (<640 GB) |
| INT4 (0.5 bytes/param) | 42 GB · Single high-end GPU (<80 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
Base model: meta-llama/Llama-3.1-70B
quantized: 11merge: 25finetune: 3adapter: 3
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| bartowski/Hermes-3-Llama-3.1-70B-GGUF | quantized | GGUF | — | — | llama3 | bartowski | 11 | 231k |
| DevQuasar-4/Hermes-2-Theta-Llama-3-70B-GGUF | quantized | GGUF | — | — | llama3 | DevQuasar-4 | 0 | 47.7k |
| mbley/NousResearch-Hermes-3-Llama-3.1-70B-AWQ | quantized | AWQ | 70.6B | XL | llama3.1 | mbley | 0 | 24.2k |
| legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF | quantized | GGUF | — | — | llama3 | legraphista | 1 | 21.3k |
| mlabonne/Hermes-3-Llama-3.1-70B-lorablated | merge | — | 70.6B | XL | — | mlabonne | 41 | 15.3k |
| mradermacher/Hermes-3-Llama-3.1-70B-i1-GGUF | quantized | GGUF | — | — | llama3 | mradermacher | 2 | 11.7k |
| backyardai/Hermes-3-Llama-3.1-70B-GGUF | quantized | GGUF | — | — | llama3 | backyardai | 2 | 6.8k |
| mradermacher/Hermes-3-Llama-3.1-70B-GGUF | quantized | GGUF | — | — | llama3 | mradermacher | 3 | 6.2k |
| Guilherme34/Hermes-3-Llama-3.1-70B-Uncensored | finetune | — | 70.6B | XL | llama3.1 | Guilherme34 | 15 | 3.2k |
| tensorblock/Hermes-3-Llama-3.1-70B-GGUF | quantized | GGUF | — | — | llama3 | tensorblock | 2 | 2.7k |
| gbueno86/Brinebreath-Llama-3.1-70B | merge | — | 70.6B | XL | llama3.1 | gbueno86 | 4 | 2.1k |
| KaraKaraWarehouse/L3.1-70b-Ginny | merge | — | 70.6B | XL | — | KaraKaraWarehouse | 0 | 2k |
| featherless-ai-quants/NousResearch-Hermes-3-Llama-3.1-70B-GGUF | quantized | GGUF | — | — | — | featherless-ai-quants | 0 | 1.6k |
| Saxo/Linkbricks-Horizon-AI-Korean-Advanced-70B | quantized | GGUF | 70.6B | XL | apache-2.0 | Saxo | 1 | 1.2k |
| Nexesenex/Llama_3.x_70b_Doberman_V1 | merge | — | 70.6B | XL | — | Nexesenex | 1 | 684 |
| Nexesenex/Llama_3.x_70b_Evasion_V1 | merge | — | 70.6B | XL | — | Nexesenex | 1 | 619 |
| olaverse/MIST-1-70B | merge | — | 70.6B | XL | llama3.1 | olaverse | 1 | 603 |
| Saxo/Linkbricks-Horizon-AI-Japanese-Base-70B | finetune | — | 70.6B | XL | apache-2.0 | Saxo | 3 | 403 |
| isetnefret/Hermes-3-Llama-3.1-70B-mlx-2Bit | quantized | mlx | 70.6B | XL | llama3 | isetnefret | 0 | 532 |
| mlx-community/MIST-1-70B-MLX | merge | MLX | 70.6B | XL | llama3.1 | mlx-community | 1 | 192 |
| mergesloppa123123/Hermyale-stack-90B | merge | — | 91.9B | XL | cc-by-nc-4.0 | mergesloppa123123 | 1 | 173 |
| Guilherme34/Hermes-3-Llama-3.1-70B-Uncensored-Lora | adapter | — | — | — | llama3 | Guilherme34 | 2 | 95 |
| harkov000/Hermes-Euryale-70B | merge | — | 70.6B | XL | — | harkov000 | 0 | 172 |
| NexesMess/Llama_3.x_70b_SmarTricks_v1.61 | merge | — | 70.6B | XL | — | NexesMess | 0 | 138 |
| Nexesenex/Llama_3.x_70b_Nemesis_V1 | merge | — | 70.6B | XL | — | Nexesenex | 1 | 49 |
| NexesMess/Llama_3.x_70b_SmarTricks_v1.55_Karcher | merge | — | 70.6B | XL | — | NexesMess | 0 | 91 |
| Cunt1257/Hermes-3-Llama-3.1-70B-Uncensored | finetune | — | 70.6B | XL | llama3.1 | Cunt1257 | 1 | 25 |
| NexesMess/Llama_3.x_70b_SmarTricks_v1.66 | merge | — | 70.6B | XL | — | NexesMess | 0 | 72 |
| mergesloppa123123/Hanames-90B-L3.1 | merge | — | 91.9B | XL | cc-by-nc-4.0 | mergesloppa123123 | 0 | 69 |
| Nexesenex/Llama_3.x_70b_SmarTricks_v1.55_MS | merge | — | 70.6B | XL | — | Nexesenex | 0 | 64 |
| Fireheart92/vire-protocol-70b | adapter | — | 70.6B | XL | llama3.1 | Fireheart92 | 0 | 62 |
| NexesMess/Llama_3.x_70b_DoberTeaz_0.1 | merge | — | 70.6B | XL | — | NexesMess | 0 | 59 |
| NexesMess/Llama_3.x_70b_TesserTeaz_0.1 | merge | — | 70.6B | XL | — | NexesMess | 0 | 48 |
| tripplet-research/astro5.1 | merge | — | 70.6B | XL | — | tripplet-research | 0 | 30 |
| Guilherme34/Reasoner-Hermes3-70b-Lora | adapter | — | — | — | llama3 | Guilherme34 | 0 | 16 |
| TareksGraveyard/Erudite-V1-Leashed-LLaMA-70B | merge | — | 70.6B | XL | — | TareksGraveyard | 0 | 16 |
| TareksLab/Sapphire-V2-LLaMa-70B | merge | — | 70.6B | XL | — | TareksLab | 0 | 9 |
| TareksGraveyard/Cerebro-V1-LLaMa-70B | merge | — | 70.6B | XL | — | TareksGraveyard | 0 | 7 |
| TareksGraveyard/MO-MODEL1-V1-LLaMa-70B | merge | — | 70.6B | XL | — | TareksGraveyard | 0 | 6 |
| TareksGraveyard/Braniac-V3-LLaMa-70B | merge | — | 70.6B | XL | — | TareksGraveyard | 0 | 5 |
| Date | Commit | SHA |
|---|---|---|
| 2024-09-08 | fixing tool_use jinja template bugs | 1fc86da |
| 2024-08-23 | Update README.md | 093242c |
| 2024-08-23 | Update README.md | 1300b7f |
| 2024-08-22 | Update tokenizer_config.json | 2cc1db8 |
| 2024-08-18 | Update tokenizer_config.json | 708a153 |
| 2024-08-15 | Update README.md | f335688 |
| 2024-08-15 | Update README.md | 946ad42 |
| 2024-08-14 | Update README.md | 8a2d72f |
| 2024-08-07 | Update README.md | ac6a5c1 |
| 2024-08-07 | Create README.md | 81518f3 |
| 2024-08-06 | Update tokenizer_config.json | b80389d |
| 2024-07-29 | Update generation_config.json | 8b728d1 |
| 2024-07-29 | Update config.json | 0bf30f2 |
| 2024-07-29 | Upload folder using huggingface_hub | 4d4094b |
| 2024-07-29 | initial commit | d784926 |
Hosted endpoints observed for Hermes-3-Llama-3.1-70B, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.70/M.
| Provider | Model ref | Context | Quant | $/M in | $/M out | tok/s | TTFT | Tools | Status | Observed |
|---|---|---|---|---|---|---|---|---|---|---|
| DeepInfra hf, openrouter | NousResearch/Hermes-3-Llama-3.1-70B | 128K | fp8 | $0.70 | $0.70 | 28 | 235 ms | no | live | 2026-10-25 |
| Featherless hf | NousResearch/Hermes-3-Llama-3.1-70B | — | — | — | — | — | — | — | live | 2026-10-25 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:41 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:13 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.
