Models › Phi-3 family

Phi-3-vision-128k-instruct

microsoft MIT out 2 years ago

4.15B parameters, text in, text out, 128K tokens of context.

Verified 2026-10-25 Rank #413 in LLMs · score 79.1 method v1 Sources 3 Downloads 30d 42.7k · #394 of 619 tracked

Can I run it?2.5GB at INT4Estimatefits a 16 GB cardmethod
Can I use it?MITPermissivelicence file2026-10-24
Do people use it?42.7kdownloads, 30 days#394 of 619 we track · below the median+2 likes, downloads −2% this week978 likesHugging Face2026-10-24

Worth reading

Picked by rule from 18 tracked pieces: the lab's own post, the most shared, a field report, the latest.

Most discussed · 411 HN pts

Phi-3 Technical Report

Phi-3 models achieve high performance rivaling Mixtral 8x7B by training on a scaled-up dataset of heavily filtered publicly available web data and synthetic data.

arxiv.org 2024-04-23 411 HN pts · 130 comments 463 words about the Phi 3 family family
Latest · 2 years ago

Microsoft Phi-3 Cookbook

Microsoft released the Phi family of open-source small language models, which are the most capable and cost-effective SLMs available.

  • Developers can use sparse checkout commands to clone the repository without downloading the translation files.
  • The project contains specific samples for Phi-4-Mini-Flash-Reasoning-Instruct for math demonstrations.
github.com 2024-05-21 152 HN pts · 57 comments 978 words about the Phi 3 family family

18 best of 18 tracked

The 2 picks above, plus these 16. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. CodeOllama v0.1.33 with Llama 3, Phi 3, and Qwen 110Bgithub.com · 2024-04-28 · 192 HN pts
  2. ArticleExploring Microsoft's Phi-3-Mini and its integration with tool like Ollamapieces.app · 2024-12-26
  3. ArticlePhi-3: Redefining what's possible with SLMsazure.microsoft.com · 2024-04-23 · 16 HN pts · official
  4. ArticlePhi-3-Mediumazure.microsoft.com · 2024-05-21 · 6 HN pts · official
  5. ArticlePhi-3 Technical a Highly Capable Language Model Locally on Your Phonehuggingface.co · 2024-04-23 · 7 HN pts
  6. DiscussionMicrosoft Updated Phi-3twitter.com · 2024-07-02 · 35 HN pts
  7. ArticleTiny but mighty: The Phi-3 small language models with big potentialnews.microsoft.com · 2024-04-23 · 6 HN pts · official
  8. ArticleBuilding Intelligent Applications with Local RAG in .NET and Phi-3techcommunity.microsoft.com · 2024-07-02 · 3 HN pts · official
  9. ArticleMicrosoft launches Phi-3, its smallest AI model yettheverge.com · 2024-04-23 · 42 HN pts
  10. ArticleThe latest major open LLM releases: Mixtral, Llama 3, Phi-3, and OpenELMmagazine.sebastianraschka.com · 2024-05-12
  11. ArticleLocal iOS/macOS phi-3-mini-4k-instructapps.apple.com · 2024-05-14
  12. ArticleMicrosoft releases powerful new Phi-3.5 models, beating Google, OpenAI and moreventurebeat.com · 2024-08-21
  13. CodeShow HN: Phi-3-MLX – Language and Vision Models for Apple Silicongithub.com · 2024-07-19
  14. ArticlePhi-3-vision in 50 lines of C# with ONNX Runtime GenAInietras.com · 2024-06-05
  15. ArticleAfter Llama3 here we have Phi-3: Small Language Models beating LLMsdidyouknowbg8.wordpress.com · 2024-04-23
  16. ArticleTrain Phi-3 Visionwandb.ai · 2024-06-01

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

No API provider serves it, so its downloads are people running it themselves: 3 quantized builds and 52 Spaces.

  • As a service0no API provider listed
  • On own hardware3quantized builds
  • Built on125 fine-tunes · 7 adapters · 0 merges
  • In apps52Hugging Face Spaces

Top Spaces running it: ysharma/Microsoft_Phi-3-Vision-128k ♥ 219 · MaziyarPanahi/Phi-3-vision-128k ♥ 47 · dwb2023/hf_extractor ♥ 6 · dwb2023/omniscience ♥ 6

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits a 16 GB card at INT4

About 2.5 GB at INT4, 5.0 GB at FP8, 10 GB at BF16: weights only, so leave room for the KV cache.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.5 GB of weights (estimate; KV cache and activations extra)INT42.5 GBFP8: about 5.0 GB of weights (estimate; KV cache and activations extra)FP85.0 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 2.5 GB of weights (estimate; KV cache and activations extra)INT42.5 GBFP8: about 5.0 GB of weights (estimate; KV cache and activations extra)FP85.0 GBBF16: about 10 GB of weights (estimate; KV cache and activations extra)BF1610 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2024-05-19), amber triangles are 10 dated articles (each links to it), grey ticks are repo commits.

MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-12-10: 2 repo commits2024-08-20: 2 repo commits2024-08-05: 1 repo commit2024-07-30: 1 repo commit2024-07-17: 2 repo commits2024-07-09: 1 repo commit2024-06-11: 1 repo commit2024-05-31: 2 repo commits2024-05-29: 1 repo commit2024-05-24: 1 repo commit2024-05-21: 5 repo commits2024-05-20: 1 repo commit2024-05-19: 1 repo commitPhi-3 Technical Report · 2024-04-23Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110B · 2024-04-28Microsoft Phi-3 Cookbook · 2024-05-21Phi-3: Redefining what's possible with SLMs · 2024-04-23Phi-3-Medium · 2024-05-21Phi-3 Technical a Highly Capable Language Model Locally on Your Phone · 2024-04-23Microsoft Updated Phi-3 · 2024-07-02Tiny but mighty: The Phi-3 small language models with big potential · 2024-04-23Building Intelligent Applications with Local RAG in .NET and Phi-3 · 2024-07-02Microsoft launches Phi-3, its smallest AI model yet · 2024-04-23Weights 2024-05-19 · 2024-05-19Weights 2024-05-19now
MayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOctNovDecJanFebMarAprMayJunJulAugSepOct2025-12-10: 2 repo commits2024-08-20: 2 repo commits2024-08-05: 1 repo commit2024-07-30: 1 repo commit2024-07-17: 2 repo commits2024-07-09: 1 repo commit2024-06-11: 1 repo commit2024-05-31: 2 repo commits2024-05-29: 1 repo commit2024-05-24: 1 repo commit2024-05-21: 5 repo commits2024-05-20: 1 repo commit2024-05-19: 1 repo commitPhi-3 Technical Report · 2024-04-23Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110B · 2024-04-28Microsoft Phi-3 Cookbook · 2024-05-21Phi-3: Redefining what's possible with SLMs · 2024-04-23Phi-3-Medium · 2024-05-21Phi-3 Technical a Highly Capable Language Model Locally on Your Phone · 2024-04-23Microsoft Updated Phi-3 · 2024-07-02Tiny but mighty: The Phi-3 small language models with big potential · 2024-04-23Building Intelligent Applications with Local RAG in .NET and Phi-3 · 2024-07-02Microsoft launches Phi-3, its smallest AI model yet · 2024-04-23Weights 2024-05-19 · 2024-05-19Weights 2024-05-19now

What people built on it

15 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

15 derivatives on the Hub, led by 7 adapters

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

3 quantized (Hugging Face model tree)5 fine-tunes (Hugging Face model tree)7 adapters (Hugging Face model tree)3 quantized5 fine-tunes7 adapters
3 quantized (Hugging Face model tree)5 fine-tunes (Hugging Face model tree)7 adapters (Hugging Face model tree)3 quantized5 fine-tunes7 adapters

All variants →

Reference

Everything else, folded: the full tables, every source.

What the card says

2 cited sentences

Summary generated, cited

Phi-3-vision-128k-instruct is a 4.15B parameter multimodal model from the Phi-3 family designed for text and vision tasks.[1][2] The model supports a 128K context length and is released under an MIT license.[3][4]

  1. parameters human
  2. “Phi-3 model family”
  3. “128K context length (in tokens) it can support”
  4. license

Generated 2026-10-07 15:09 UTC by parasail-gemma-4-26b-a4b-it; each numeral points at the fact it rests on. Not a verdict.

Use-case evidence

7 use cases

What it is good at 7 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

21 fields

Listed in LLMs

Facts

Pipeline tagtext-generation
Librarytransformers
ArchitecturesPhi3VForCausalLM
Model typephi3_v
Dtypebfloat16
Params by dtypeBF16: 4,146,621,440
Size bandM
MoEno
Context length131,072 (config.json max_position_embeddings)
Languagesmultilingual
LicenseMIT (mit)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Phi3VForCausalLM · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: not in registry · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for Phi-3-vision-128k-instruct: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)10 GB · Single GPU (<24 GB)
FP8 (1 byte/param)5.0 GB · Single GPU (<24 GB)
INT4 (0.5 bytes/param)2.5 GB · Edge (<4 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra.

All variants

15 variants

Lineage

Original model Family: microsoft/Phi-3 15 derivatives on the Hub

adapter: 7finetune: 5quantized: 3

Top variants (15 shown, ranked by downloads)

Relation
15 rows
Variant Relation Quant Params Band License Author Likes Downloads
NTT-hil-insight/VDocRetriever-Phi3-vision adapter — — — — NTT-hil-insight 2 3.2k
NTT-hil-insight/VDocGenerator-Phi3-vision adapter — — — — NTT-hil-insight 1 1.5k
MCG-NJU/VideoChatOnline-4B finetune — 4.15B M mit MCG-NJU 1 1.1k
RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128 quantized -W4A16 4.27B M apache-2.0 RedHatAI 1 855
puar-playground/Phi-3-MusiX adapter — — — mit puar-playground 1 465
puar-playground/Col-Phi-3-V adapter — — — — puar-playground 0 480
onnx-community/Phi-3-vision-128k-instruct quantized — — — — onnx-community 1 426
NTT-hil-insight/VDocRetriever-Phi3-vision-pretrained adapter — — — — NTT-hil-insight 0 305
MuyeHuang/EvoChart finetune — — — gpl-3.0 MuyeHuang 1 225
SkyNetdev/Phi3v-Finetuned finetune — 4.25B M apache-2.0 SkyNetdev 1 198
yanghaoir/ReAlign-Phi3v adapter — — — mit yanghaoir 1 132
llmware/phi-3-vision-onnx quantized — — — apache-2.0 llmware 0 127
farshadafx/results adapter — — — mit farshadafx 0 33
aschirru34/results finetune — — — — aschirru34 0 0
laicsiifes/phi3-vision-flickr30k_pt_human_generated finetune — — — mit laicsiifes 0 0

Repository changelog

21 commits

Repository changelog 21 commits

DateCommitSHA
2025-12-10 Update README.md (#73) ed2772f
2025-12-10 Upload data_summary_card.md (#72) 7c760c5
2024-08-20 Update README.md c45209e
2024-08-20 Update README.md 5bc05f2
2024-08-05 Fix generation when `repetition_penalty` is activated (#57) 6065b7a
2024-07-30 Fix number of image tokens (#51) b161793
2024-07-17 Rewrite image embedding to remove the in-place op (#53) 866d169
2024-07-17 Use Flash Attention for CLIP image encoder (#52) 1a87b10
2024-07-09 Update README.md f998a18
2024-06-11 clean_sample_code (#36) 7b92b8c
2024-05-31 Make flash attention configurable in user code (#26) fea3f11
2024-05-31 Add link to Phi-3 vision ONNX models 11cb03c
2024-05-29 correct the paper reference (#25) 5dcfdfb
2024-05-24 Update README.md (#14) dbcdaaa
2024-05-21 Update README 2b07137
2024-05-21 Update README 94f6e2f
2024-05-21 Update README 034a3df
2024-05-21 Update README d33b637
2024-05-21 Update README 4ed3dc0
2024-05-20 chore(root): Initial files upload. 44c7c8b
2024-05-19 initial commit 7ba0150

Articles and coverage

18 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official4

azure.microsoft.com2024-04-23officialauthorityabout the Phi 3 familyHN 16 pts · 1 comments1,074 words
Microsoft introduces Phi-3, a family of open small language models including the upcoming Phi-3-small (7B) and Phi-3-medium (14B). Phi-3-mini is a 3.8B parameter model available on Azure AI Studio, Hugging Face, and Ollama with a context window of up to 128K tokens. The models have lower capacity to retain facts on factual knowledge benchmarks due to their smaller size.written, reviewed, cited
  • Phi-3-mini can be used on-device, especially when further optimized with ONNX Runtime for cross-platform availability.
azure.microsoft.com2024-05-21officialauthorityabout the Phi 3 familyHN 6 pts · 1 comments1,243 words
news.microsoft.com2024-04-23officialauthorityabout the Phi 3 familyHN 6 pts · 0 comments
techcommunity.microsoft.com2024-07-02officialauthorityabout the Phi 3 familyHN 3 pts · 0 comments7,796 words

Analysis5

arxiv.org2024-04-23authorityHN front pageabout the Phi 3 familyHN 411 pts · 130 comments463 words
Phi-3 models achieve high performance rivaling Mixtral 8x7B by training on a scaled-up dataset of heavily filtered publicly available web data and synthetic data. This approach enables deployment locally on your phone despite small parameter counts like the 3.8 billion in phi-3-mini. The phi-3.5-MoE variant reaches 78% on MMLU with 6.6 billion active parameters, while phi-3.5-Vision handles multi-image prompts.written, reviewed, cited
github.com2024-04-28authorityHN front pageabout the Phi 3 familyHN 192 pts · 64 comments38 words
github.com2024-05-21authorityHN front pageabout the Phi 3 familyHN 152 pts · 57 comments978 words
Microsoft released the Phi family of open-source small language models, which are the most capable and cost-effective SLMs available. The repository includes 50+ language translations that significantly increase download size, requiring sparse checkout to clone without them. Specific samples include Phi-4-Reasoning-Vision-15B for reasoning-vision tasks, and the models support deployment on cloud or edge devices. Developers should integrate Azure AI Content Safety to detect harmful user-generated and AI-generated content in applications.written, reviewed, cited
  • Developers can use sparse checkout commands to clone the repository without downloading the translation files.
  • The project contains specific samples for Phi-4-Mini-Flash-Reasoning-Instruct for math demonstrations.
huggingface.co2024-04-23authorityabout the Phi 3 familyHN 7 pts · 7 comments1,073 words
theverge.com2024-04-23about the Phi 3 familyHN 42 pts · 3 comments

Community1

twitter.com2024-07-02about the Phi 3 familyHN 35 pts · 15 comments
All coverage tracked for this model (18) — append-only, nothing is ever removed
TitleSourcePublishedFirst seenSignals
Exploring Microsoft's Phi-3-Mini and its integration with tool like Ollamapieces.app2024-12-262026-10-07hn
Microsoft releases powerful new Phi-3.5 models, beating Google, OpenAI and moreventurebeat.com2024-08-212026-10-07hn
Show HN: Phi-3-MLX – Language and Vision Models for Apple Silicongithub.com2024-07-192026-10-07hn
Building Intelligent Applications with Local RAG in .NET and Phi-3techcommunity.microsoft.com official2024-07-022026-10-07hn
Microsoft Updated Phi-3twitter.com2024-07-022026-10-07hn
Phi-3-vision in 50 lines of C# with ONNX Runtime GenAInietras.com2024-06-052026-10-07hn
Train Phi-3 Visionwandb.ai2024-06-012026-10-07hn
Microsoft Phi-3 Cookbookgithub.com2024-05-212026-10-07hn
Phi-3-Mediumazure.microsoft.com official2024-05-212026-10-07hn
Local iOS/macOS phi-3-mini-4k-instructapps.apple.com2024-05-142026-10-07hn
The latest major open LLM releases: Mixtral, Llama 3, Phi-3, and OpenELMmagazine.sebastianraschka.com2024-05-122026-10-07hn
Ollama v0.1.33 with Llama 3, Phi 3, and Qwen 110Bgithub.com2024-04-282026-10-07hn
After Llama3 here we have Phi-3: Small Language Models beating LLMsdidyouknowbg8.wordpress.com2024-04-232026-10-07hn
Phi-3: Redefining what's possible with SLMsazure.microsoft.com official2024-04-232026-10-07hn
Tiny but mighty: The Phi-3 small language models with big potentialnews.microsoft.com official2024-04-232026-10-07hn
Phi-3 Technical a Highly Capable Language Model Locally on Your Phonehuggingface.co2024-04-232026-10-07hn
Microsoft launches Phi-3, its smallest AI model yettheverge.com2024-04-232026-10-07hn
Phi-3 Technical Reportarxiv.org2024-04-232026-10-07hn

Similar models

3 models

Similar models

  • Qwen3-4B · 4.02B
    same size band (M), same task (text-generation), more providers, permissive license
  • Qwen3-4B-Instruct-2507 · 4.02B
    same size band (M), same task (text-generation), more providers, permissive license
  • Qwen3-4B-Thinking-2507 · 4.02B
    same size band (M), same task (text-generation), more providers, permissive license

Sources

3 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:39 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:46 UTC · Summary: 2026-10-07 15:09 UTC · Last verified 2026-10-25

Follow Phi-3-vision-128k-instruct

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.