Where to run it Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.
# Cheapest live row In /1M Out /1M Context Quant Seen 1 HF Inference — — — — Oct 25
All 1 provider →
Will it fit? Weights only, an estimate: leave room for the KV cache. Method
Fits a 16 GB card at BF16 About 0.1 GB at BF16: weights only, so leave room for the KV cache.
16 GB card 64 GB Mac 2×80 GB 8×80 GB BF16: about 0.1 GB of weights (estimate; KV cache and activations extra) BF16 0.1 GB
16 GB card 64 GB Mac 2×80 GB 8×80 GB BF16: about 0.1 GB of weights (estimate; KV cache and activations extra) BF16 0.1 GB
Estimate params × bytes per param × 1.2 · how we estimate
How it scores Third-party measurements only; author-reported numbers stay in Reference , marked as such.
#27 of 64 on MTEB so far 61.32. Each tick is a model on this site with a measured MTEB row; author-reported numbers stay in Reference. Mean(task) x100 over 41 tasks. 41 tasks, split=test
BAAI/bge-multilingual-gemma2: 78.95 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-8B: 75.22 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-4B: 74.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en: 72.33 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-0.6B: 70.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-300m: 69.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-8B: 69.44 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-4B: 68.46 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/multi-qa-MiniLM-L6-cos-v1: 67.83 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-2: 67.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v3: 66.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-large-en-v1.5: 65.89 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large-instruct: 65.56 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en-v1.5: 65.14 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results thenlper/gte-large: 64.77 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-small-en-v1.5: 64.3 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v2-moe: 63.64 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-l-v2.0: 63.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1: 63.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-m3: 63.21 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-large-v2: 62.79 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-base-v2: 62.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Alibaba-NLP/gte-multilingual-base: 62.51 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1.5: 62.2 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large: 62.07 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-0.6B: 61.83 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-m: 61.09 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results ibm-granite/granite-embedding-small-english-r2: 61.07 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-base: 61 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-small: 59.69 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/all-mpnet-base-v2: 59.62 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-l-v2.0: 58.56 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-mpnet-base-v2: 58.27 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-m: 57.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2: 56.42 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-300m: 55.69 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-large-en-v1.5: 55.44 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v2-moe: 54.81 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en-v1.5: 54.75 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v3: 54.29 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results ibm-granite/granite-embedding-small-english-r2: 53.93 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-small-en-v1.5: 53.86 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large-instruct: 53.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results thenlper/gte-large: 53.29 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large: 51.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-2: 51.33 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-small-en: 51.02 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Alibaba-NLP/gte-multilingual-base: 50.87 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1: 50.72 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-base-v2: 49.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-large-v2: 49.31 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-base: 48.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/LaBSE: 48.81 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1.5: 47.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-small: 46.43 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-base-en: 45.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/all-mpnet-base-v2: 44.54 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-mpnet-base-v2: 37.14 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2: 35.93 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-base-en: 26.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-small-en: 26.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/LaBSE: 18.05 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results 0 100 61.32 · #27 of 64
BAAI/bge-multilingual-gemma2: 78.95 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-8B: 75.22 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-4B: 74.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en: 72.33 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-0.6B: 70.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-300m: 69.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-8B: 69.44 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-4B: 68.46 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/multi-qa-MiniLM-L6-cos-v1: 67.83 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-2: 67.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v3: 66.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-large-en-v1.5: 65.89 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large-instruct: 65.56 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en-v1.5: 65.14 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results thenlper/gte-large: 64.77 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-small-en-v1.5: 64.3 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v2-moe: 63.64 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-l-v2.0: 63.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1: 63.6 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-m3: 63.21 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-large-v2: 62.79 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-base-v2: 62.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Alibaba-NLP/gte-multilingual-base: 62.51 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1.5: 62.2 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large: 62.07 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Qwen/Qwen3-Embedding-0.6B: 61.83 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-m: 61.09 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results ibm-granite/granite-embedding-small-english-r2: 61.07 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-base: 61 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-small: 59.69 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/all-mpnet-base-v2: 59.62 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-l-v2.0: 58.56 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-mpnet-base-v2: 58.27 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Snowflake/snowflake-arctic-embed-m: 57.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2: 56.42 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-300m: 55.69 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-large-en-v1.5: 55.44 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v2-moe: 54.81 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-base-en-v1.5: 54.75 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v3: 54.29 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results ibm-granite/granite-embedding-small-english-r2: 53.93 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results BAAI/bge-small-en-v1.5: 53.86 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large-instruct: 53.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results thenlper/gte-large: 53.29 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-large: 51.53 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results google/embeddinggemma-2: 51.33 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-small-en: 51.02 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results Alibaba-NLP/gte-multilingual-base: 50.87 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1: 50.72 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-base-v2: 49.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/e5-large-v2: 49.31 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-base: 48.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/LaBSE: 48.81 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results nomic-ai/nomic-embed-text-v1.5: 47.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results intfloat/multilingual-e5-small: 46.43 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-base-en: 45.97 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/all-mpnet-base-v2: 44.54 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-mpnet-base-v2: 37.14 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2: 35.93 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-base-en: 26.67 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results jinaai/jina-embeddings-v2-small-en: 26.47 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results sentence-transformers/LaBSE: 18.05 · observed 2026-10-25 · https://huggingface.co/datasets/mteb/results 0 100 61.32 · #27 of 64
Source · leaderboard · 2026-10-24
The story so far Weights, every dated article, and repo commits on one rail.
17 repo commits since the weights landed Teal is the weights (2023-05-19), grey ticks are repo commits.
Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct 2025-02-17: 4 repo commits 2023-08-16: 1 repo commit 2023-08-07: 1 repo commit 2023-07-27: 1 repo commit 2023-07-20: 4 repo commits 2023-06-18: 1 repo commit 2023-05-22: 1 repo commit 2023-05-19: 4 repo commits Weights 2023-05-19 · 2023-05-19 Weights 2023-05-19 now · 1 provider
Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct 2025-02-17: 4 repo commits 2023-08-16: 1 repo commit 2023-08-07: 1 repo commit 2023-07-27: 1 repo commit 2023-07-20: 4 repo commits 2023-06-18: 1 repo commit 2023-05-22: 1 repo commit 2023-05-19: 4 repo commits Weights 2023-05-19 · 2023-05-19 Weights 2023-05-19 now · 1 provider
What people built on it 64 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
64 derivatives on the Hub, most of them fine-tunes From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
15 quantized (Hugging Face model tree) 46 fine-tunes (Hugging Face model tree) 3 adapters (Hugging Face model tree) 15 quantized46 fine-tunes3 adapters
15 quantized (Hugging Face model tree) 46 fine-tunes (Hugging Face model tree) 3 adapters (Hugging Face model tree) 15 quantized46 fine-tunes3 adapters
All variants →
Reference Everything else, folded: the full tables, every source.
Benchmarks 3 rows Benchmarks 3 rows measured third-party leaderboard row (3)author-reported number from the model card or eval filesNo confidence intervals unless the source gave them; settings differ between rows, so compare within a benchmark, not across. Date = the benchmark's own date when it gives one, else when we read it.
What the card says 1 cited sentence Use-case evidence 2 use cases What it is good at 2 use cases Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases .
Facts 21 fields Listed in Embeddings
Facts Pipeline tag sentence-similarity Library sentence-transformers Architectures BertModel Model type bert Dtype float32 Params by dtype F32: 33,360,000 · I64: 512 Size band S MoE no Context length 512 (config.json max_position_embeddings) Languages en Papers arXiv:2212.03533 , arXiv:2104.08663 , arXiv:2210.07316 License MIT (mit) Hub snapshot 2026-10-25
Servability vLLM · SGLang Hardware fit 3 estimates Hardware fit ESTIMATE Weights-only memory for e5-small-v2: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed .
BF16 (2 bytes/param) 0.1 GB · Edge (<4 GB) FP8 (1 byte/param) 0.0 GB · Edge (<4 GB) INT4 (0.5 bytes/param) 0.0 GB · Edge (<4 GB)
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
All variants 40 variants Lineage finetune: 46 quantized: 15 adapter: 3
Top variants (40 shown, ranked by downloads) Repository changelog 17 commits Repository changelog 17 commits Date Commit SHA 2025-02-17 Add exported openvino model 'openvino_model_qint8_quantized.xml' (#15) ffb93f3 2025-02-17 Add exported openvino model 'openvino_model.xml' (#14) 4bc52f9 2025-02-17 Add exported onnx model 'model_O4.onnx' (#13) d908e34 2025-02-17 Add exported onnx model 'model_qint8_avx512_vnni.onnx' (#12) f17a0f7 2023-08-16 Make the tokenizer config match that of the large and base versions (#11) dca8b1a 2023-08-07 Update README.md 93da57d 2023-07-27 add sentence similarity tag b092564 2023-07-20 Add TF weights (#3) 4a074f4 2023-07-20 Adding ONNX file of this model (#1) 47ba724 2023-07-20 Adding `safetensors` variant of this model (#7) 5c28755 2023-07-20 Update README.md cfb7694 2023-06-18 add sentence transformers configs (#4) 7f5bd82 2023-05-22 Update README.md c2a786b 2023-05-19 Update README.md 6cf6a8c 2023-05-19 update README.md e32cfbb 2023-05-19 upload model weights d7c6f2a 2023-05-19 initial commit b584ff7
All providers 1 provider · 1 endpoint Where to run 1 providers · 1 endpoints Hosted endpoints observed for e5-small-v2, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.
Provider Model ref Context Quant $/M in $/M out tok/s TTFT Tools Status Observed HF Inferencehf
intfloat/e5-small-v2 — — — — — — — live 2026-10-25
Articles and coverage 2 pieces Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Analysis2 webai.show 842 words
E5-small-v2 is a 33M-parameter embedder that outputs 384-dimensional vectors and requires distinct prefixes for input. It uses a query: prefix for searches and a passage: prefix for documents to optimize retrieval performance. The model runs on-device via WebAssembly with q8 quantization at ~34 MB under an MIT license.written, reviewed, cited
E5 mean-pools token vectors and L2-normalizes them so every sentence becomes a unit-length arrow. The model loads MiniLM, BGE, and GTE on demand to show how four embedders disagree on similarity. Inference runs in a Web Worker so the matrix, projection, and comparison never jank the page. savrn.com 2,650 words
e5-small-v2 is an open-weight sentence-transformers model by Liang Wang designed for semantic search and clustering tasks. It has 33M parameters and a 512-token context, mapping text to 384-dimensional vectors under the MIT License. At 16-bit precision it needs about 0.1 GB of GPU memory, fitting on 1x MI300X from $1.85 an hour.written, reviewed, cited
The stored precision is float32, so the 16-bit figure assumes conversion on load. The publisher's usage prefixes inputs with query: and passage:, and an index built without those prefixes is not the same index. The model was first published on 2023-05-19 and last updated on 2025-02-17. Papers 3 papers Papers 3 arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).
Similar models 3 models Sources 3 sources Sources Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:04 UTC · Last verified 2026-10-25
Follow e5-small-v2 Watch this model Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.