Up to date
openchat Apache 2.0 out 3 years ago
7.24B parameters, text in, text out. 1 provider serves it.
Verified 2026-10-25 Rank #693 in LLMs · score 72.2 method v1 Sources 3 Downloads 30d 75.5k · #345 of 619 tracked
Picked by rule from 3 tracked pieces: the lab's own post, the most shared, a field report, the latest.
The 1 pick above, plus these 2. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
| # | Cheapest live row | In /1M | Out /1M | Context | Quant | Seen |
|---|---|---|---|---|---|---|
| 1 | Featherless | — | — | — | — | Oct 25 |
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
Served by 1 API provider; 10 quantized builds for local use.
Weights only, an estimate: leave room for the KV cache. Method
About 4.3 GB at INT4, 8.7 GB at FP8, 17 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2023-12-12), amber triangles are 3 dated articles (each links to it).
39 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | text-generation |
|---|---|
| Library | transformers |
| Architectures | MistralForCausalLM |
| Model type | mistral |
| Params by dtype | BF16: 7,241,748,480 |
| Size band | M |
| MoE | no |
| Papers | arXiv:2309.11235, arXiv:2303.08774 |
| License | Apache 2.0 (apache-2.0) |
| Hub snapshot | 2026-10-25 |
Weights-only memory for openchat-3.5-1210: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 17 GB · Single GPU (<24 GB) |
|---|---|
| FP8 (1 byte/param) | 8.7 GB · Single GPU (<24 GB) |
| INT4 (0.5 bytes/param) | 4.3 GB · Single GPU (<24 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
Base model: mistralai/Mistral-7B-v0.1
quantized: 10merge: 14adapter: 14finetune: 1
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| TheBloke/openchat-3.5-1210-GGUF | quantized | GGUF | — | — | apache-2.0 | TheBloke | 51 | 84.4k |
| EmbeddedLLM/Mistral-7B-Merge-14-v0.3 | merge | — | 7.24B | M | apache-2.0 | EmbeddedLLM | 8 | 19.2k |
| EmbeddedLLM/Mistral-7B-Merge-14-v0.3-ft-step-15936 | merge | — | 7.24B | M | apache-2.0 | EmbeddedLLM | 0 | 17k |
| EmbeddedLLM/Mistral-7B-Merge-14-v0.3-ft-step-9984 | merge | — | 7.24B | M | apache-2.0 | EmbeddedLLM | 0 | 17k |
| Weyaxi/OpenHermes-2.5-neural-chat-v3-3-openchat-3.5-1210-Slerp | merge | — | 7.24B | M | apache-2.0 | Weyaxi | 2 | 14.9k |
| mradermacher/openchat-3.5-1210-i1-GGUF | quantized | GGUF | — | — | apache-2.0 | mradermacher | 0 | 10.6k |
| MaziyarPanahi/openchat-3.5-1210-GGUF | quantized | GGUF | — | — | apache-2.0 | MaziyarPanahi | 0 | 7.3k |
| second-state/openchat-3.5-1210-GGUF | quantized | GGUF | — | — | apache-2.0 | second-state | 0 | 6.5k |
| TheBloke/openchat-3.5-1210-GPTQ | quantized | GPTQ | 7.24B | M | apache-2.0 | TheBloke | 4 | 5.3k |
| mayacinka/Open-StaMis-v02-stock | merge | — | 7.24B | M | apache-2.0 | mayacinka | 1 | 5.1k |
| TheBloke/openchat-3.5-1210-AWQ | quantized | AWQ | 7.24B | M | apache-2.0 | TheBloke | 2 | 5k |
| mradermacher/openchat-3.5-1210-GGUF | quantized | GGUF | — | — | apache-2.0 | mradermacher | 1 | 4.8k |
| tensorblock/openchat-3.5-1210-GGUF | quantized | GGUF | — | — | apache-2.0 | tensorblock | 0 | 2k |
| bogdal/ru_openchat3.5-1210_summarization_adapter | adapter | — | — | — | other | bogdal | 7 | 485 |
| itlwas/openchat-3.5-1210-Q4_K_M-GGUF | quantized | GGUF | — | — | apache-2.0 | itlwas | 0 | 509 |
| mohsinmubaraksk/Beast-Mixed_3_pro | merge | — | 7.24B | M | — | mohsinmubaraksk | 1 | 217 |
| mgv99/mistral-moe | merge | — | 12.9B | L | apache-2.0 | mgv99 | 0 | 240 |
| ajay141/Chat-generation | merge | — | 7.24B | M | — | ajay141 | 0 | 231 |
| mgv99/olaolaola | merge | — | 12.9B | L | apache-2.0 | mgv99 | 0 | 142 |
| sethut/openchat-3.5-1210-Q8_0-GGUF | quantized | Q8_0 | — | — | apache-2.0 | sethut | 0 | 140 |
| mgv99/my-llm | merge | — | 12.9B | L | apache-2.0 | mgv99 | 0 | 114 |
| mgv99/prueba-moe2 | merge | — | — | — | mit | mgv99 | 0 | 111 |
| mgv99/prueba-moe | merge | — | — | — | mit | mgv99 | 0 | 105 |
| ArchSid/RHQE_openchat_layer_-16 | adapter | — | — | — | — | ArchSid | 0 | 100 |
| Ro-xe/FMixAI_7B | merge | — | 7.24B | M | — | Ro-xe | 0 | 73 |
| ArchSid/RHQE_openchat_layer_-5 | adapter | — | — | — | — | ArchSid | 0 | 57 |
| mayurmmg/finetunedModelVersion-1 | finetune | — | 7.24B | M | apache-2.0 | mayurmmg | 0 | 55 |
| mgv99/joooojoooo | merge | — | 12.9B | L | apache-2.0 | mgv99 | 0 | 54 |
| ai-simonsk13/MentalHealth-Openchat-7b-finetune | adapter | — | — | — | — | ai-simonsk13 | 0 | 38 |
| baltop/open_600 | adapter | — | — | — | — | baltop | 0 | 34 |
| baltop/open_400 | adapter | — | — | — | — | baltop | 0 | 31 |
| tdh87/StoryTime | adapter | — | — | — | — | tdh87 | 0 | 30 |
| houghtonweihu/openchat_adapter_1 | adapter | — | — | — | — | houghtonweihu | 0 | 29 |
| ArchSid/RHQE_openchat_layer_-7 | adapter | — | — | — | — | ArchSid | 0 | 29 |
| baltop/open_300 | adapter | — | — | — | — | baltop | 0 | 28 |
| baltop/open_500 | adapter | — | — | — | — | baltop | 0 | 24 |
| ArchSid/RHQE_openchat_layer_-1 | adapter | — | — | — | — | ArchSid | 0 | 21 |
| elliotthwang/OpenChatC-RLFT-tw_train_ouputs | adapter | — | — | — | — | elliotthwang | 0 | 19 |
| elliotthwangmsa/OpenChatC-RLFT-tw_train_ouputs | adapter | — | — | — | — | elliotthwangmsa | 0 | 16 |
Hosted endpoints observed for openchat-3.5-1210, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.
| Provider | Model ref | Context | Quant | $/M in | $/M out | tok/s | TTFT | Tools | Status | Observed |
|---|---|---|---|---|---|---|---|---|---|---|
| Featherless hf | openchat/openchat-3.5-1210 | — | — | — | — | — | — | — | live | 2026-10-25 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-14 14:08 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.
