Models › distiluse family

distiluse-base-multilingual-cased-v1

sentence-transformers Apache 2.0 out 5 years ago

135M parameters, text in, embeddings out, 512 tokens of context. 1 provider serves it.

Verified 2026-10-25 Rank #37 in Embeddings · score 92.3 method v1 Sources 3 Downloads 30d 1.5M · #85 of 619 tracked

Can I run it?0.1GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?Apache 2.0Permissive; patent grantlicence file2026-10-24
Do people use it?1.5Mdownloads, 30 days#85 of 619 we track · top 14%+4 likes, downloads +5% this week145 likesHugging Face2026-10-24

Worth reading

Picked by rule from 5 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Latest · 6 years ago

Questions about distiluse-base-multilingual-cased and make_multilingual.py · Issue #505 · huggingface/sentence-transformers

distiluse-base-multilingual-cased supports 50+ languages out-of-the-box for tasks like STS or duplicate detection without further training.

  • The model is much better for languages where you have parallel data compared to languages where you don't have parallel data.
  • The listed languages in the documentation are the additional languages besides English, meaning English is supported by default.
github.com 2020-10-18 696 words about the distiluse family family

5 best of 5 tracked

The 1 pick above, plus these 4. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. Codedistiluse-base-multilingual-cased has one more dense layer compared to the pool-only model. How is this dense layer added?github.com · undated
  2. CodeDoubt about distiluse-base-multilingual-casedgithub.com · undated
  3. Articledistiluse-base-multilingua…cased-v1 by Sentence Transformerssavrn.com · undated
  4. Articledistiluse-base-multilingual-cased-v1 — Sentence Embedding…modeldatabase.com · undated

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

#Cheapest live rowIn /1MOut /1MContextQuantSeen
1 HF Inference — — — — Oct 25

All 1 provider →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 1 API provider; 1 quantized build for local use.

  • As a service1HF Inference
  • On own hardware1quantized builds
  • Built on2222 fine-tunes · 0 adapters · 0 merges
  • In apps15Hugging Face Spaces

Top Spaces running it: somosnlp-hackathon-2022/BioMedIA ♥ 99 · eduardofv/multilang_semantic_search_wikisimple ♥ 2

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 0.1 GB at INT4, 0.2 GB at FP8, 0.3 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.1 GB of weights (estimate; KV cache and activations extra)INT40.1 GBFP8: about 0.2 GB of weights (estimate; KV cache and activations extra)FP80.2 GBBF16: about 0.3 GB of weights (estimate; KV cache and activations extra)BF160.3 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 0.1 GB of weights (estimate; KV cache and activations extra)INT40.1 GBFP8: about 0.2 GB of weights (estimate; KV cache and activations extra)FP80.2 GBBF16: about 0.3 GB of weights (estimate; KV cache and activations extra)BF160.3 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

1 dated article and 21 repo commits so far

Teal is the weights (2022-03-02), amber triangles are 1 dated article (each links to it), grey ticks are repo commits.

NovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-03-06: 1 repo commit2024-11-05: 1 repo commit2024-10-11: 11 repo commits2024-03-27: 1 repo commit2024-02-12: 1 repo commit2023-11-02: 1 repo commit2022-06-15: 1 repo commit2021-11-02: 1 repo commit2021-08-05: 1 repo commit2021-06-22: 2 repo commitsQuestions about distiluse-base-multilingual-cased and make_multilingual.py · Issue #505 · huggingface/sentence-transformers · 2020-10-18Weights 2022-03-02 · 2022-03-02Weights 2022-03-02now · 1 provider
NovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-03-06: 1 repo commit2024-11-05: 1 repo commit2024-10-11: 11 repo commits2024-03-27: 1 repo commit2024-02-12: 1 repo commit2023-11-02: 1 repo commit2022-06-15: 1 repo commit2021-11-02: 1 repo commit2021-08-05: 1 repo commit2021-06-22: 2 repo commitsQuestions about distiluse-base-multilingual-cased and make_multilingual.py · Issue #505 · huggingface/sentence-transformers · 2020-10-18Weights 2022-03-02 · 2022-03-02Weights 2022-03-02now · 1 provider

What people built on it

23 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

23 derivatives on the Hub, most of them fine-tunes

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

1 quantized (Hugging Face model tree)22 fine-tunes (Hugging Face model tree)1 quantized22 fine-tunes
1 quantized (Hugging Face model tree)22 fine-tunes (Hugging Face model tree)1 quantized22 fine-tunes

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

1 cited sentence

Summary generated, cited

It maps sentences and paragraphs to a 512 dimensional dense vector space for clustering or semantic search.[1]

  1. “maps sentences & paragraphs to a 512 dimensional dense ve…”

Generated 2026-10-07 15:03 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

3 use cases

What it is good at 3 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in Embeddings

Facts

Pipeline tagsentence-similarity
Librarysentence-transformers
ArchitecturesDistilBertModel
Model typedistilbert
Params by dtypeF32: 134,734,080
Size bandS
MoEno
Context length512 (config.json max_position_embeddings)
Languagesmultilingual, ar, zh, nl, en, fr, de, it, ko, pl, pt, ru, es, tr
PapersarXiv:1908.10084
LicenseApache 2.0 (apache-2.0)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: not in registry · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for distiluse-base-multilingual-cased-v1: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)0.3 GB · Edge (<4 GB)
FP8 (1 byte/param)0.2 GB · Edge (<4 GB)
INT4 (0.5 bytes/param)0.1 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

23 variants

Lineage

Original model Family: sentence-transformers/distiluse 23 derivatives on the Hub

quantized: 1finetune: 22

Top variants (23 shown, ranked by downloads)

Relation
23 rows
Variant Relation Quant Params Band License Author Likes Downloads
Xenova/distiluse-base-multilingual-cased-v1 quantized — — — — Xenova 0 6.3k
bardsai/finance-sentiment-pl-fast finetune — 135M S apache-2.0 bardsai 4 5k
bardsai/twitter-sentiment-pl-fast finetune — 135M S apache-2.0 bardsai 0 5.2k
bardsai/twitter-emotion-pl-fast finetune — 135M S apache-2.0 bardsai 0 4.8k
bardsai/finance-sentiment-zh-fast finetune — 135M S apache-2.0 bardsai 8 4.4k
FrancescoPeriti/TRoTR-distiluse-base-multilingual-cased-v1 finetune — 135M S cc-by-sa-4.0 FrancescoPeriti 0 344
winderfeld/cc-uffs-ppc-distiluse-base-multilingual-cased-v1-finetuned finetune — 135M S — winderfeld 0 221
Kowshik24/bangla-sentence-transformer-ft-matryoshka-distiluse-base-multilingual-cased-v1 finetune — 135M S apache-2.0 Kowshik24 0 196
DimaSK1/distiluse-base-multilingual-cased-v1-for-find-population finetune — 135M S — DimaSK1 0 186
fede-m/FGSDI_final_setfit_fold_0 finetune — 135M S — fede-m 0 129
truongcongminh/AI_captone1 finetune — 135M S — truongcongminh 0 125
theunmans/dist-multi finetune — 135M S apache-2.0 theunmans 0 118
iammbrn/alsatix_similarity_model finetune — 135M S — iammbrn 0 110
fede-m/FGSDI_final_setfit_fold_1 finetune — 135M S — fede-m 0 101
fede-m/FGSDI_final_setfit_fold_4 finetune — 135M S — fede-m 0 72
cbpuschmann/distiluse-base-multilingual-cased-klimacoder_v0.9 finetune — 135M S — cbpuschmann 0 52
fede-m/FGSDI_final_setfit_fold_2 finetune — 135M S — fede-m 0 44
fede-m/FGSDI_final_setfit_fold_3 finetune — 135M S — fede-m 0 43
zeromodels/distiluse-base-multilingual-cased-v1 finetune — — — apache-2.0 zeromodels 0 33
segmue/geo-distiluse-swissnames3d-config1 finetune — 135M S apache-2.0 segmue 0 30
segmue/geo-distiluse-swissnames3d-config2 finetune — 135M S apache-2.0 segmue 0 26
segmue/geo-distiluse-swissnames3d finetune — 135M S apache-2.0 segmue 0 22
BSE-NLP/Venzuela_PersonalFinance_Classifier finetune — 135M S — BSE-NLP 0 0

Repository changelog

21 commits

Repository changelog 21 commits

DateCommitSHA
2025-03-06 Remove deprecated (SEB) evaluation results section 826fee3
2024-11-05 Add exported openvino model 'openvino_model_qint8_quantized.xml' 457e815
2024-10-11 Add new SentenceTransformer model with an openvino backend 30487a8
2024-10-11 Add new SentenceTransformer model with an openvino backend fe0fbfb
2024-10-11 Add exported ONNX model 'model_qint8_avx512_vnni.onnx' 0c8f0be
2024-10-11 Add exported ONNX model 'model_qint8_avx512.onnx' 4f5acee
2024-10-11 Add exported ONNX model 'model_quint8_avx2.onnx' 17e63c4
2024-10-11 Add exported ONNX model 'model_qint8_arm64.onnx' f6e4ba6
2024-10-11 Add exported ONNX model 'model_O4.onnx' 139cc92
2024-10-11 Add exported ONNX model 'model_O3.onnx' df1ef45
2024-10-11 Add exported ONNX model 'model_O2.onnx' a05ad73
2024-10-11 Add exported ONNX model 'model_O1.onnx' 1792cd5
2024-10-11 Add new SentenceTransformer model with an onnx backend 97cc87d
2024-03-27 Adding `safetensors` variant of this model (#5) ae9f5e0
2024-02-12 Update Sentence Transformers metadata (#4) 2620b63
2023-11-02 Update README.md (#1) 01d3415
2022-06-15 Add TF weights 756c7aa
2021-11-02 Update README.md e6c3af0
2021-08-05 Update README.md 3a706e4
2021-06-22 Add new SentenceTransformer model. 66df1a0
2021-06-22 initial commit def3b34

All providers

1 provider · 1 endpoint

Where to run 1 providers · 1 endpoints

Hosted endpoints observed for distiluse-base-multilingual-cased-v1, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
HF Inference
hf
sentence-transformers/distiluse-base-multilingual-cased-v1 — — — — — — — live 2026-10-25

Articles and coverage

5 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Analysis2

savrn.com1,780 words
Sentence Transformers released distiluse-base-multilingual-cased-v1, an open-weight model for sentence similarity under the Apache License 2.0. The 135M parameter model features a 512-token context and maps text to a 512-dimensional vector space for clustering or semantic search. At 16-bit precision, it requires about 0.3 GB of GPU memory, fitting on a single MI300X rented for $1.85 an hour, and draws 1.5M downloads a month.written, reviewed, cited
  • The model requires chunking longer passages because its 512-token context limit is strict.
  • Sentence Transformers built the model on DistilBERT using a vocabulary with 119,547 entries.
  • The model ships in multiple formats including safetensors, ONNX, OpenVINO, PyTorch, and TensorFlow.
modeldatabase.com203 words
sentence-transformers/distiluse-base-multilingual-cased-v1 maps sentences to a 512 dimensional dense vector space for clustering or semantic search. The model architecture includes a Transformer with max_seq_length: 128 and do_lower_case: False, followed by mean token pooling and a Dense layer with Tanh activation. It has recorded 68,568 downloads last month.written, reviewed, cited

Community3

github.comauthorityabout the distiluse family676 words
The distiluse-base-multilingual-cased model adds a dense layer on top of mean pooling to transform DistilBERT's 768-dimensional output into 512 dimensions, matching the Universal Sentence Encoder's format. This architecture allows the model to function as a student in a knowledge distillation setup where the teacher is the multilingual Universal Sentence Encoder. The method enables extending sentence embedding models to new languages using parallel training data.written, reviewed, cited
  • The distiluse-base-multilingual-cased model uses the training process from the paper Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation.
github.comauthorityabout the distiluse family929 words
The distiluse-base-multilingual-cased model outputs a 512 dimension tensor instead of the typical 768 because it uses a dense layer to down-project the 768 dimension output to 512 dimensions. This down projection was necessary as the model is a distillation of the multilingual Universal Sentence Encoder which uses 512 dimension. The developer plans to add the models to the huggingface models collection within the next 2 weeks.written, reviewed, cited
github.com2020-10-18authorityabout the distiluse family696 words
distiluse-base-multilingual-cased supports 50+ languages out-of-the-box for tasks like STS or duplicate detection without further training. The model includes English plus 53 additional languages, though performance drops for those without parallel data. Training on new tasks is possible but not required for standard use cases.written, reviewed, cited
  • The model is much better for languages where you have parallel data compared to languages where you don't have parallel data.
  • The listed languages in the documentation are the additional languages besides English, meaning English is supported by default.

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:36 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow distiluse-base-multilingual-cased-v1

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.