paraphrase-multilingual-MiniLM-L12-v2 by sentence-transformers - Overview, Benchmarks & Hardware | Q4KM.ai
The sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 model is a multilingual sentence-embedding encoder built on the MiniLM-L12 architecture that converts sentences into 384-dimensional vectors across 30+ languages.
- The model supports a maximum sequence length of 128 tokens using the WordPiece tokenizer from the original MiniLM-L12 checkpoint.
- Training required a cluster of 8 × NVIDIA V100 GPUs for roughly 12 hours employing mixed-precision (FP16) to accelerate convergence.