Phi-3 Technical Report
Phi-3 models achieve high performance rivaling Mixtral 8x7B by training on a scaled-up dataset of heavily filtered publicly available web data and synthetic data.
Up to date
3.82B parameters, text in, text out, 128K tokens of context.
Verified 2026-10-25 Rank #210 in LLMs · score 88.4 method v1 Sources 3 Downloads 30d 246.5k · #236 of 619 tracked
Picked by rule from 23 tracked pieces: the lab's own post, the most shared, a field report, the latest.
Phi-3 models achieve high performance rivaling Mixtral 8x7B by training on a scaled-up dataset of heavily filtered publicly available web data and synthetic data.
Microsoft's Phi-3-Mini is a 3.8 billion-parameter language model designed for efficiency on devices with limited resources like notebooks and smartphones.
The 2 picks above, plus these 21. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.
Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.
No API provider serves it, so its downloads are people running it themselves: 87 quantized builds and 100 Spaces.
Top Spaces running it: jbilcke-hf/tikslop ♥ 305 · allenai/WildBench ♥ 232 · allenai/ZebraLogic ♥ 95 · microsoft/MInference ♥ 61
Weights only, an estimate: leave room for the KV cache. Method
About 2.3 GB at INT4, 4.6 GB at FP8, 9.2 GB at BF16: weights only, so leave room for the KV cache.
Estimate params × bytes per param × 1.2 · how we estimate
Weights, every dated article, and repo commits on one rail.
Teal is the weights (2024-04-22), amber triangles are 9 dated articles (each links to it), grey ticks are repo commits.
536 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.
From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.
Everything else, folded: the full tables, every source.
| Benchmark | Value | Setting / notes | Reported by | Date |
|---|---|---|---|---|
| author-reported Average | 37.3 | June 2024 Update | model author | 2026-10-07 |
| author-reported GPQA Diamond · Reason through hard problems | 29.7 | June 2024 Update | model author | 2026-10-07 |
| author-reported Instruction Extra Hard | 5.9 | June 2024 Update | model author | 2026-10-07 |
| author-reported Instruction Hard | 5.2 | June 2024 Update | model author | 2026-10-07 |
| author-reported JSON Structure Output | 60.1 | June 2024 Update | model author | 2026-10-07 |
| author-reported MMLU · Reason through hard problems | 69.7 | June 2024 Update | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 92.4 | June 2024 Update 4K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 91.1 | June 2024 Update 8K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 90.8 | June 2024 Update 16K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 87.9 | June 2024 Update 32K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 79.8 | June 2024 Update 64K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 65.6 | June 2024 Update 128K | model author | 2026-10-07 |
| author-reported RULER · Read long documents | 84.6 | June 2024 Update Average | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 85 | June 2024 Update Python | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 63 | June 2024 Update C++ | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 72 | June 2024 Update Rust | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 93 | June 2024 Update Java | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 72 | June 2024 Update TypeScript | model author | 2026-10-07 |
| author-reported RepoQA · Write code with agents | 77 | June 2024 Update Average | model author | 2026-10-07 |
| author-reported XML Structure Output | 52.9 | June 2024 Update | model author | 2026-10-07 |
Phi-3-mini-128k-instruct is a 3.82B parameter text-generation model from the Phi-3 family.[1][2] The model supports a context length of 128K tokens and is released under the MIT license.[3][4]
Generated 2026-10-07 15:05 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.
Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.
Listed in LLMs
| Pipeline tag | text-generation |
|---|---|
| Library | transformers |
| Architectures | Phi3ForCausalLM |
| Model type | phi3 |
| Dtype | bfloat16 |
| Params by dtype | BF16: 3,821,079,552 |
| Size band | M |
| MoE | no |
| Context length | 131,072 (config.json max_position_embeddings) |
| Languages | en |
| License | MIT (mit) |
| Hub snapshot | 2026-10-25 |
vLLM: supported · Phi3ForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Phi3ForCausalLM · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed
vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.
Weights-only memory for Phi-3-mini-128k-instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.
| BF16 (2 bytes/param) | 9.2 GB · Single GPU (<24 GB) |
|---|---|
| FP8 (1 byte/param) | 4.6 GB · Single GPU (<24 GB) |
| INT4 (0.5 bytes/param) | 2.3 GB · Edge (<4 GB) |
Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.
merge: 13quantized: 87finetune: 44adapter: 392
| Variant | Relation | Quant | Params | Band | License | Author | Likes | Downloads |
|---|---|---|---|---|---|---|---|---|
| OpenGVLab/InternVL2-4B | merge | — | 4.15B | M | mit | OpenGVLab | 57 | 597.4k |
| bartowski/Phi-3.1-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | bartowski | 36 | 163.8k |
| lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | lmstudio-community | 7 | 87.4k |
| OpenGVLab/Mini-InternVL-Chat-4B-V1-5 | merge | — | 4.15B | M | mit | OpenGVLab | 62 | 50.5k |
| legraphista/Phi-3-mini-128k-instruct-IMat-GGUF | quantized | GGUF | — | — | mit | legraphista | 0 | 29.1k |
| second-state/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | second-state | 2 | 24k |
| qwp4w3hyb/Phi-3-mini-128k-instruct-iMat-GGUF | quantized | GGUF | — | — | mit | qwp4w3hyb | 0 | 23k |
| gaianet/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | gaianet | 1 | 12.9k |
| solidrust/Phi-3-mini-128k-instruct-AWQ | quantized | AWQ | 3.82B | M | — | solidrust | 1 | 10.6k |
| professorf/phi-3-mini-128k-f16-gguf | quantized | gguf | — | — | mit | professorf | 5 | 10.1k |
| mradermacher/Phi-3-mini-128k-instruct-i1-GGUF | quantized | GGUF | — | — | mit | mradermacher | 0 | 5.1k |
| tensorblock/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | tensorblock | 0 | 5k |
| calcuis/phi3 | quantized | GGUF | — | — | mit | calcuis | 0 | 5k |
| OpenVINO/Phi-3-mini-128k-instruct-int4-ov | quantized | int4 | — | — | mit | OpenVINO | 3 | 4.6k |
| OEvortex/EMO-phi-128k | finetune | — | 3.82B | M | mit | OEvortex | 10 | 4k |
| AlessandroW/Phi-3-mini-128k-instruct-gguf | quantized | gguf | — | — | mit | AlessandroW | 1 | 3.2k |
| RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8 | quantized | -quant | 3.82B | M | mit | RedHatAI | 0 | 2.8k |
| mradermacher/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | mradermacher | 1 | 2.7k |
| Ffftdtd5dtft/Phi-3-mini-128k-instruct-IQ2_XXS-GGUF | quantized | GGUF | — | — | mit | Ffftdtd5dtft | 1 | 2.6k |
| BenevolenceMessiah/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | BenevolenceMessiah | 0 | 2.6k |
| OpenVINO/Phi-3-mini-128k-instruct-int8-ov | quantized | int8 | — | — | mit | OpenVINO | 5 | 2.2k |
| justinthelaw/Phi-3-mini-128k-instruct-4bit-128g-GPTQ | quantized | -4bit | 3.82B | M | apache-2.0 | justinthelaw | 1 | 1.9k |
| Ffftdtd5dtft/Phi-3-mini-128k-instruct-Q2_K-GGUF | quantized | Q2_K | — | — | mit | Ffftdtd5dtft | 0 | 1.9k |
| CHE-72-ZLab/Microsoft-Phi3-14B-Instruct128K-GGUF | quantized | GGUF | — | — | mit | CHE-72-ZLab | 0 | 1.8k |
| leliuga/Phi-3-mini-128k-instruct-bnb-4bit | quantized | -bnb | 3.93B | M | other | leliuga | 1 | 1.5k |
| OpenVINO/Phi-3-mini-128k-instruct-fp16-ov | finetune | -fp16 | — | — | mit | OpenVINO | 0 | 1.2k |
| newsletter/Phi-3-mini-128k-instruct-Q6_K-GGUF | quantized | Q6_K | — | — | mit | newsletter | 0 | 1.1k |
| paulilioaica/MixtureOfPhi3 | finetune | — | 6.24B | M | apache-2.0 | paulilioaica | 9 | 630 |
| mlc-ai/Phi-3-mini-128k-instruct-q4f16_1-MLC | quantized | — | — | — | — | mlc-ai | 1 | 951 |
| DhruvalLabs/Phi-3-mini-128k-instruct-GGUF | quantized | GGUF | — | — | mit | DhruvalLabs | 0 | 920 |
| gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF | quantized | GGUF | — | — | mit | gate369 | 0 | 893 |
| RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16 | quantized | -quant | 3.82B | M | mit | RedHatAI | 0 | 851 |
| CitrusBoy/FinetunedModelV2.0 | adapter | — | 3.88B | M | mit | CitrusBoy | 0 | 839 |
| CHE-72/Phi-3-mini-128k-instruct-Q6_K-GGUF | quantized | Q6_K | — | — | mit | CHE-72 | 0 | 823 |
| Muhammad2003/Orpo-Phi3-3B-128K | finetune | — | 3.82B | M | apache-2.0 | Muhammad2003 | 3 | 617 |
| praysimanjuntak/llava-phi3-3.8b-lora | finetune | — | 4.14B | M | — | praysimanjuntak | 5 | 517 |
| awels/maximusLLM-3b-128k-gguf | quantized | gguf | — | — | mit | awels | 1 | 663 |
| Ejafa/phi-3-mini-128k-instruct-simpo-lr-5e-07-gamma-1.5 | finetune | — | 3.82B | M | mit | Ejafa | 0 | 685 |
| Antonio88/TaliML-PHI3-128K-ITA-V.1.0.FINAL | finetune | — | 3.82B | M | mit | Antonio88 | 0 | 642 |
| suraiy/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed-Q4_K_M-GGUF | quantized | -4bit | — | — | — | suraiy | 0 | 623 |
| Date | Commit | SHA |
|---|---|---|
| 2025-12-10 | Update README.md (#104) | f3c06ae |
| 2025-12-10 | Upload data_summary_card.md (#103) | 17fb6f6 |
| 2025-03-02 | Update readme | 072cb75 |
| 2024-08-20 | Update README.md | a90b62a |
| 2024-07-01 | Minor updates for README | d548c23 |
| 2024-07-01 | Update model (#84) | 10d25df |
| 2024-06-14 | Add the classifiers to the auto_map (#76) | bb5bf1e |
| 2024-05-31 | Add attention_bias to make TGI work (#68) | 5be6479 |
| 2024-05-31 | Add link to Phi-3 vision ONNX models | 6417fb9 |
| 2024-05-30 | Update sample_finetune.py (#70) | 3c014d5 |
| 2024-05-22 | Update sample_finetune.py (#69) | bbd531d |
| 2024-05-21 | Update README | 30e8c65 |
| 2024-05-02 | fix(tokenizer): Also updates tokenizer.json to prevent any mismatch. | 8a362e7 |
| 2024-05-02 | fix(tokenizer_config): Adjusts `rstrip` of special tokens. (#54) | 82eebd7 |
| 2024-04-29 | Update README.md | 39d6675 |
| 2024-04-29 | fix(root): Replaces system by user to improve generation experience. | fc313b0 |
| 2024-04-26 | Update README.md | 810c2e6 |
| 2024-04-26 | Update sample_finetune.py (#42) | 0693e0b |
| 2024-04-26 | chore(readme): Adds a proper chat example to widget. | 49f911d |
| 2024-04-25 | fix(readme): Adds information about placeholder tokens. | f10fb29 |
| 2024-04-25 | fix(tokenizer_config): Ensures model_max_length corresponds to actual maximum number. | 48788d7 |
| 2024-04-22 | chore(root): Initial files upload. | 7de6f02 |
| 2024-04-22 | initial commit | f310673 |
Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:37 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:05 UTC · Last verified 2026-10-25
Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.