Models › multi family

multi-qa-mpnet-base-dot-v1

sentence-transformers Not declared out 5 years ago

109M parameters, text in, embeddings out, 514 tokens of context. 2 providers serve it from $0.005 per million input tokens.

Verified 2026-10-25 Rank #27 in Embeddings · score 95.9 method v1 Sources 3 Downloads 30d 1.5M · #81 of 619 tracked

Can I run it?0.1GB at INT4Estimatefits a 16 GB cardmethod
What does it cost?$0.005/1M incheapest of 1DeepInfra2026-10-24
Can I use it?Not declaredNo license declared on the model cardlicence file2026-10-24
Do people use it?1.5Mdownloads, 30 days#81 of 619 we track · top 13%+2 likes, downloads +3% this week206 likesHugging Face2026-10-24

Worth reading

Picked by rule from 5 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 687 HN pts

Accelerating Gemma 4: faster inference with multi-token prediction drafters

Google released Multi-Token Prediction (MTP) drafters for the Gemma 4 family under the same open-source Apache 2.0 license as Gemma 4.

  • The MTP drafter shares the target model's KV cache to avoid recalculating context the larger model has already processed.
  • For E2B and E4B edge models, an efficient clustering technique in the embedder accelerates generation where logit calculation is a bottleneck.
blog.google 2026-05-05 687 HN pts · 330 comments 796 words about the multi family family

5 best of 5 tracked

The 1 pick above, plus these 4. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. Articlemulti-qa-mpnet-base-dot-v1 - AtomGit AI社区ai.gitcode.com · undated
  2. Articlemulti-qa-mpnet-base-dot-v1 by Sentence Transformerssavrn.com · undated
  3. Articlemulti-qa-mpnet-base-dot-v1:multi-qa-mpnet-base-dot-v1 · sentence embedding / semantic search · 昇腾 NPU(torch_npu)适配 - AtomGit AI社区ai.gitcode.com · undated
  4. Articlemulti-qa-mpnet-base-dot-v1 | Jaaved Ali Khanjaaved.netlify.app · 2024-03-13

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest 2In /1MOut /1MContextQuantSeen
1 DeepInfra $0.005 — 512 — Oct 24
2 HF Inference — — — — Oct 25

All 2 providers →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 2 API providers; 1 quantized build for local use.

  • As a service2DeepInfra, HF Inference
  • On own hardware1quantized builds
  • Built on2020 fine-tunes · 0 adapters · 0 merges
  • In apps100+Hugging Face Spaces

Top Spaces running it: Ekimetrics/climate-question-answering ♥ 150 · nickmuchi/semantic-search-with-retrieve-and-rerank ♥ 71 · ThePixOne/open_domain_qa ♥ 31 · anakin87/who-killed-laura-palmer ♥ 16

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.1 GB at INT4, 0.1 GB at FP8, 0.3 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.1 GB of weights (estimate; KV cache and activations extra)INT40.1 GBFP8: about 0.1 GB of weights (estimate; KV cache and activations extra)FP80.1 GBBF16: about 0.3 GB of weights (estimate; KV cache and activations extra)BF160.3 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.1 GB of weights (estimate; KV cache and activations extra)INT40.1 GBFP8: about 0.1 GB of weights (estimate; KV cache and activations extra)FP80.1 GBBF16: about 0.3 GB of weights (estimate; KV cache and activations extra)BF160.3 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

2 dated articles and 23 repo commits so far

Teal is the weights (2022-03-02), amber triangles are 2 dated articles (each links to it), grey ticks are repo commits.

SepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-08-19: 1 repo commit2024-11-05: 1 repo commit2024-10-15: 9 repo commits2024-10-10: 2 repo commits2024-05-07: 1 repo commit2024-03-27: 1 repo commit2024-02-12: 1 repo commit2023-11-02: 1 repo commit2022-07-11: 1 repo commit2022-07-08: 2 repo commits2022-07-07: 1 repo commit2021-08-23: 2 repo commitsAccelerating Gemma 4: faster inference with multi-token prediction drafters · 2026-05-05multi-qa-mpnet-base-dot-v1 | Jaaved Ali Khan · 2024-03-13Weights 2022-03-02 · 2022-03-02Weights 2022-03-02now · 2 providers
SepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-08-19: 1 repo commit2024-11-05: 1 repo commit2024-10-15: 9 repo commits2024-10-10: 2 repo commits2024-05-07: 1 repo commit2024-03-27: 1 repo commit2024-02-12: 1 repo commit2023-11-02: 1 repo commit2022-07-11: 1 repo commit2022-07-08: 2 repo commits2022-07-07: 1 repo commit2021-08-23: 2 repo commitsAccelerating Gemma 4: faster inference with multi-token prediction drafters · 2026-05-05multi-qa-mpnet-base-dot-v1 | Jaaved Ali Khan · 2024-03-13Weights 2022-03-02 · 2022-03-02Weights 2022-03-02now · 2 providers

What people built on it

21 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

21 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

1 quantized (Hugging Face model tree)20 fine-tunes (Hugging Face model tree)1 quantized20 fine-tunes
1 quantized (Hugging Face model tree)20 fine-tunes (Hugging Face model tree)1 quantized20 fine-tunes

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Designed for semantic search, it maps sentences and paragraphs to a 768 dimensional dense vector space.[1] The model was trained on 215M (question, answer) pairs from diverse sources.[2]

  1. “maps sentences & paragraphs to a 768 dimensional dense ve…”
  2. “trained on 215M (question, answer) pairs from diverse sou…”

Generated 2026-10-07 15:01 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

2 use cases

What it is good at 2 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

20 fields

Listed in Embeddings

Facts

Pipeline tagsentence-similarity
Librarysentence-transformers
ArchitecturesMPNetForMaskedLM
Model typempnet
Params by dtypeF32: 109,486,464 · I64: 514
Size bandS
MoEno
Context length514 (config.json max_position_embeddings)
Languagesen
LicenseNot declared
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: not in registry · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for multi-qa-mpnet-base-dot-v1: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)0.3 GB · Edge (<4 GB)
FP8 (1 byte/param)0.1 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.1 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

21 variants

Lineage

Original model Family: sentence-transformers/multi 21 derivatives on the Hub

quantized: 1finetune: 20

Top variants (21 shown, ranked by downloads)

Relation
21 rows
Variant Relation Quant Params Band License Author Likes Downloads
Xenova/multi-qa-mpnet-base-dot-v1 quantized — — — — Xenova 1 20.9k
Deehan1866/finetuned-sentence-transformers-multi-qa-mpnet-base-dot-v1 finetune — 109M S — Deehan1866 0 538
winderfeld/cc-uffs-ppc-ft-test-multiqa finetune — 109M S — winderfeld 0 536
Faith1712/multi-qa-mpnet-glaive-godotdocs-dot finetune — 109M S — Faith1712 1 416
antonkirk/retrieval-mpnet-dot-finetuned-llama3-openbiollm-synthetic-dataset finetune — 109M S — antonkirk 0 452
mustozsarac/finetuned-one-epoch-multi-qa-mpnet-base-dot-v1 finetune — 109M S — mustozsarac 0 413
Marco127/Argu_T1 finetune — 109M S — Marco127 0 375
Marco127/Argu_T3 finetune — 109M S — Marco127 0 339
yashmalviya/multi-qa-mpnet-base-dot-v1-4-frozen finetune — 109M S — yashmalviya 0 313
antonkirk/retrieval-mpnet-dot-finetuned-gpt-4o-mini-synthetic-dataset finetune — 109M S — antonkirk 0 295
mustozsarac/finetuned-four-epoch-multi-qa-mpnet-base-dot-v1 finetune — 109M S — mustozsarac 0 290
antonkirk/retrieval-mpnet-dot-finetuned-combined-synthetic-dataset finetune — 109M S — antonkirk 0 280
antonkirk/retrieval-mpnet-dot-finetuned-llama3-synthetic-dataset finetune — 109M S — antonkirk 0 232
Marco127/Argu_T2 finetune — 109M S — Marco127 0 202
yuriivoievidka/microsoft_mpnet-base-librarian finetune — 109M S — yuriivoievidka 0 194
Marco127/D1_finetuned_2_test_1 finetune — 109M S — Marco127 0 185
Marco127/Base_Test1_ finetune — 109M S — Marco127 0 135
Marco127/Base_T finetune — 109M S — Marco127 0 131
Marco127/Argu_T finetune — 109M S — Marco127 0 95
Bombek1/multi-qa-mpnet-base-dot-v1-litert finetune — — — apache-2.0 Bombek1 0 68
zeromodels/multi-qa-mpnet-base-dot-v1 finetune — — — — zeromodels 0 31

Repository changelog

23 commits

Repository changelog 23 commits

DateCommitSHA
2025-08-19 Add `text-embeddings-inference` tag & snippet (#8) 17997f2
2024-11-05 Add exported openvino model 'openvino_model_qint8_quantized.xml' 4633e80
2024-10-15 Add new SentenceTransformer model with an openvino backend bc0175d
2024-10-15 Add new SentenceTransformer model with an openvino backend 743f0ae
2024-10-15 Add exported ONNX model 'model_qint8_avx512_vnni.onnx' ce3bc13
2024-10-15 Add exported ONNX model 'model_qint8_avx512.onnx' 0c69552
2024-10-15 Add exported ONNX model 'model_quint8_avx2.onnx' e4cf088
2024-10-15 Add exported ONNX model 'model_qint8_arm64.onnx' a7fa31f
2024-10-15 Add exported ONNX model 'model_O4.onnx' 9752c42
2024-10-15 Add exported ONNX model 'model_O3.onnx' 047ff9a
2024-10-15 Add exported ONNX model 'model_O2.onnx' 377a79b
2024-10-10 Add exported ONNX model 'model_O1.onnx' 90f1430
2024-10-10 Add new SentenceTransformer model with an onnx backend e43f3b6
2024-05-07 Add "dot" similarity function 3af7c6d
2024-03-27 Adding `safetensors` variant of this model (#5) 39c51f7
2024-02-12 Update Sentence Transformers metadata (#6) c6c6914
2023-11-02 Update README.md (#4) 334a5b7
2022-07-11 adding training dataset 69cf908
2022-07-08 adding training datasets 99192ea
2022-07-08 adding training datasets b1de898
2022-07-07 adding training datasets 014067c
2021-08-23 upload 0675a4f
2021-08-23 initial commit 5ddb11d

All providers

2 providers · 2 endpoints

Where to run 2 providers · 2 endpoints

Hosted endpoints observed for multi-qa-mpnet-base-dot-v1, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.0050/M.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
DeepInfra
deepinfra
sentence-transformers/multi-qa-mpnet-base-dot-v1 512 — $0.0050 — — — — live 2026-10-24
HF Inference
hf
sentence-transformers/multi-qa-mpnet-base-dot-v1 — — — — — — — live 2026-10-25

Articles and coverage

5 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

blog.google2026-05-05authorityHN front pageabout the multi familyHN 687 pts · 330 comments796 words
Google released Multi-Token Prediction (MTP) drafters for the Gemma 4 family under the same open-source Apache 2.0 license as Gemma 4. These drafters deliver up to a 3x speedup for models like the 26B MoE and 31B Dense versions without quality degradation. Benchmarks on hardware such as the NVIDIA RTX PRO 6000 show that increasing batch sizes to 4 to 8 unlocks up to a ~2.2x speedup locally.written, reviewed, cited
  • The MTP drafter shares the target model's KV cache to avoid recalculating context the larger model has already processed.
  • For E2B and E4B edge models, an efficient clustering technique in the embedder accelerates generation where logit calculation is a bottleneck.
  • The 26B mixture-of-experts model presents unique routing challenges at a batch size of 1 on Apple Silicon.

Analysis4

ai.gitcode.com423 words
savrn.com1,486 words
multi-qa-mpnet-base-dot-v1 is an open-weight sentence similarity model from Sentence Transformers designed for semantic search. It has 109M parameters and a 514-token context, requiring about 0.3 GB of GPU memory at 16-bit precision. The model was trained on 215M question and answer pairs, but the license field is empty, so commercial use requires confirmed publisher terms. At 16-bit, it runs on a 1x MI300X for $1.85 an hour.written, reviewed, cited
  • The model requires chunking documents first because its 514-token input limit is too short for long contexts.
  • The total download size is 3.8 GB because the repository includes safetensors, onnx, openvino, and pytorch versions.
ai.gitcode.com1,150 words
jaaved.netlify.app2024-03-13241 words
multi-qa-mpnet-base-dot-v1 is the best performing sentence-transformers model for semantic search in English. It achieves an average performance of 62.18 across 14 datasets and requires 420 MB of storage. The model supports a maximum sequence length of 512 tokens and uses CLS pooling for dot-product scoring.written, reviewed, cited

Similar models

3 models

Similar models

  • all-mpnet-base-v2 · 109M
    same size band (S), same task (sentence-similarity), permissive license
  • paraphrase-multilingual-MiniLM-L12-v2 · 118M
    same size band (S), same task (sentence-similarity), fewer providers, permissive license
  • e5-base-v2 · 109M
    same size band (S), same task (sentence-similarity), permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:01 UTC · Last verified 2026-10-25

Follow multi-qa-mpnet-base-dot-v1

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.