Up to date
Models › all-distilroberta-v1 family
sentence-transformers Apache 2.0 out 5 years ago
82.1M parameters, text in, embeddings out, 514 tokens of context. 1 provider serves it.
Verified 2026-10-25 Rank #39 in Embeddings · score 91.9 method v1 Sources 3 Downloads 30d 2.7M · #52 of 619 tracked
Picked by rule from 3 tracked pieces: the lab's own post, the most shared, a field report, the latest.
all-distilroberta-v1 has 82M parameters and e5-base-v2 has 109M parameters.
The 1 pick above, plus these 2. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
| # | Cheapest live row | In /1M | Out /1M | Context | Quant | Seen |
|---|---|---|---|---|---|---|
| 1 | HF Inference | — | — | — | — | Oct 25 |
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
Served by 1 API provider; 1 quantized build for local use; a big base for builders (57 fine-tunes, adapters and merges).
Top Spaces running it: embedl/hfviewer ♥ 181 · Gradio-Blocks/pubmed-abstract-retriever ♥ 14 · pritamdeka/health-article-keyphrase-generator ♥ 8 · pritamdeka/pubmed-abstract-retriever ♥ 6
Weights only, an estimate: leave room for the KV cache. Method
About 0.1 GB at FP8, 0.2 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2022-03-02), grey ticks are repo commits.
58 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
It maps sentences and paragraphs to a 768 dimensional dense vector space for tasks like clustering or semantic search.[1]
Generated 2026-10-07 15:04 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in Embeddings
| Pipeline tag | sentence-similarity |
|---|---|
| Library | sentence-transformers |
| Architectures | RobertaForMaskedLM |
| Model type | roberta |
| Params by dtype | F32: 82,118,400 · I64: 514 |
| Size band | S |
| MoE | no |
| Context length | 514 (config.json max_position_embeddings) |
| Languages | en |
| Papers | arXiv:1904.06472, arXiv:2102.07033, arXiv:2104.08727, arXiv:1704.05179, arXiv:1810.09305 |
| License | Apache 2.0 (apache-2.0) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · RobertaForMaskedLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · RobertaForMaskedLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for all-distilroberta-v1: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 0.2 GB · Edge (<4 GB) |
|---|---|
| FP8 (1 byte/param) | 0.1 GB · Edge (<4 GB) |
| INT4 (0.5 bytes/param) | 0.0 GB · Edge (<4 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
finetune: 56quantized: 1adapter: 1
| Date | Commit | SHA |
|---|---|---|
| 2025-03-06 | Remove deprecated (SEB) evaluation results section | 842eaed |
| 2024-11-05 | Add exported openvino model 'openvino_model_qint8_quantized.xml' | 8d88b92 |
| 2024-10-11 | Add new SentenceTransformer model with an openvino backend | bbb937e |
| 2024-10-11 | Add new SentenceTransformer model with an openvino backend | 7f49a90 |
| 2024-10-11 | Add exported ONNX model 'model_qint8_avx512_vnni.onnx' | 02df657 |
| 2024-10-11 | Add exported ONNX model 'model_qint8_avx512.onnx' | 28c2858 |
| 2024-10-11 | Add exported ONNX model 'model_quint8_avx2.onnx' | 687cd95 |
| 2024-10-11 | Add exported ONNX model 'model_qint8_arm64.onnx' | 83cde5c |
| 2024-10-11 | Add exported ONNX model 'model_O4.onnx' | bddf8d1 |
| 2024-10-11 | Add exported ONNX model 'model_O3.onnx' | 19a2a0c |
| 2024-10-11 | Add exported ONNX model 'model_O2.onnx' | 9f1b370 |
| 2024-10-11 | Add exported ONNX model 'model_O1.onnx' | 88d887b |
| 2024-10-11 | Add new SentenceTransformer model with an onnx backend | 71d05f8 |
| 2024-03-27 | Adding `safetensors` variant of this model (#5) | 14e2a3f |
| 2024-02-12 | Update Sentence Transformers metadata (#3) | 72ec7c5 |
| 2024-02-12 | Update dataset | 2c73fdc |
| 2022-07-11 | adding training dataset | 57dd5d5 |
| 2022-07-08 | adding training dataset | 5ece6db |
| 2022-07-08 | adding training dataset | 9329100 |
| 2022-07-08 | Adding training datasets | c9a018b |
| 2022-07-07 | adding training datasets | e5e0bba |
| 2022-06-21 | rust_weights (#1) | 073209d |
| 2021-08-30 | Update sentence_bert_config.json | 7e9534f |
| 2021-08-18 | update readme | 278590c |
| 2021-08-18 | upload | ac8d0d1 |
| 2021-08-18 | initial commit | 6431b9d |
Hosted endpoints observed for all-distilroberta-v1, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.
| Provider | Model ref | Context | Quant | $/M in | $/M out | tok/s | TTFT | Tools | Status | Observed |
|---|---|---|---|---|---|---|---|---|---|---|
| HF Inference hf | sentence-transformers/all-distilroberta-v1 | — | — | — | — | — | — | — | live | 2026-10-25 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.
