Models › GLM-4.5V family

zai-org MIT out 14 months ago

108B parameters (8 of 128 experts per token), images and text in, text out, 64K tokens of context. 2 providers serve it from $0.60 per million input tokens.

Verified 2026-10-25 Rank #156 in LLMs · score 91.9 method v1 Sources 4 Downloads 30d 25.2k · #440 of 619 tracked

Can I run it?65GB at INT4Estimatefits 2×80 GBmethod
What does it cost?$0.60/1M incheapest of 2Novitafp82026-10-25
Can I use it?MITPermissivelicence file2026-10-24
Do people use it?25.2kdownloads, 30 days#440 of 619 we track · below the median+2 likes, downloads −21% this week726 likesHugging Face2026-10-24

Worth reading

Picked by rule from 8 tracked pieces: the lab's own post, the most shared, a field report, the latest.

The GLM-4.5V model requires removing specific tags from its fine-tuning dataset.

From GLM-4.5V: An open-source multimodal large language model from Zhipu AI · github.com · 2025-08-11
Most discussed · 27 HN pts

GLM-4.5V: An open-source multimodal large language model from Zhipu AI

ZhipuAI released the GLM-4.6V series, featuring a 106B foundation model and a 9B Flash variant optimized for local deployment.

  • This repository will no longer be maintained as of 2026/09/02.
  • The GLM-4.5V model requires removing specific tags from its fine-tuning dataset.
github.com 2025-08-11 27 HN pts 2.1k words
Latest · 6 months ago

GLM-4.5V Local Setup: Zhipu's 106B Vision-Language MoE (2026)

GLM-4.5V is Zhipu AI's August 2025 open-weight vision-language MoE with 106B total parameters and 12B activated per token.

  • Engineers must use a llama.cpp build released after September 2025 to achieve full GLM-4.5V compatibility.
localaimaster.com 2026-05-02 2.4k words

8 best of 8 tracked

The 3 picks above, plus these 5. Top is the radar's score: discussion, source authority and the lab's own posts, fading with age.

  1. PaperGLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningarxiv.org · undated
  2. ArticleGLM-4.5V — Megatron Bridge - NVIDIA Documentationdocs.nvidia.com · undated
  3. ArticleGLM-4.5V: The World's Leading Open-Source Vision ...siliconflow.com · undated
  4. ArticleGLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning: Analysis, Review & Summary | Paperiumpaperium.net · 2026-02-08
  5. ArticleGLM-4.5V: Z.ai Open Vision-Language Model | AI/TLDRai-tldr.dev · 2025-08-11

Where to run it

Live hosted endpoints, cheapest first, USD per million tokens. Ties break on output price, then provider name.

2 providers from $0.60

2 providers with a live price, from $0.60 to $0.60 per million input tokens; the median is $0.60. One dot per provider, cheapest in teal.

$0.010$0.10$1.00$10.00Novita: $0.60 in / $1.80 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/zai-org/GLM-4.5V?expand[]=inferenceProviderMappingZ.ai: $0.60 in / $1.80 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/zai-org/GLM-4.5V?expand[]=inferenceProviderMappingcheapest $0.60median $0.60
$0.010$0.10$1.00$10.00Novita: $0.60 in / $1.80 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/zai-org/GLM-4.5V?expand[]=inferenceProviderMappingZ.ai: $0.60 in / $1.80 out per 1M · observed 2026-10-25 · https://huggingface.co/api/models/zai-org/GLM-4.5V?expand[]=inferenceProviderMappingcheapest $0.60 · median $0.60 (white tick)
#Cheapest 2In /1MOut /1MContextQuantSeen
1 Novita $0.60 $1.80 64K fp8 Oct 25
2 Z.ai $0.60 $1.80 64K fp8 Oct 25

All 2 providers →

Where it's used

Hugging Face does not say who downloads a model or with what. These are the proxies: API providers listing it, quantized builds, fine-tunes/adapters/merges, and Spaces that load it.

Served by 2 API providers; 10 quantized builds for local use.

  • As a service2Novita, Z.ai
  • On own hardware10quantized builds
  • Built on55 fine-tunes · 0 adapters · 0 merges
  • In apps42Hugging Face Spaces

Top Spaces running it: jairwaal/image ♥ 16 · umint/openwebui ♥ 6 · akhaliq/zai-org-GLM-4.5V ♥ 5 · Jakob08/moneychatbot ♥ 3

Will it fit?

Weights only, an estimate: leave room for the KV cache. Method

Fits two 80 GB GPUs at INT4; too big for one

About 65 GB at INT4, 129 GB at FP8, 259 GB at BF16: weights only, so leave room for the KV cache. Every expert must be resident, so total parameters count.

16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 65 GB of weights (estimate; KV cache and activations extra)INT465 GBFP8: about 129 GB of weights (estimate; KV cache and activations extra)FP8129 GBBF16: about 259 GB of weights (estimate; KV cache and activations extra)BF16259 GB
16 GB card64 GB Mac2×80 GB8×80 GBINT4: about 65 GB of weights (estimate; KV cache and activations extra)INT465 GBFP8: about 129 GB of weights (estimate; KV cache and activations extra)FP8129 GBBF16: about 259 GB of weights (estimate; KV cache and activations extra)BF16259 GB

Estimate params × bytes per param × 1.2 · how we estimate

The story so far

Weights, every dated article, and repo commits on one rail.

Most coverage came in the first two weeks

Teal is the weights (2025-08-10), amber triangles are 5 dated articles (each links to it), grey ticks are repo commits.

What people built on it

15 derivatives on the Hub. Which build to run, by runtime: the most downloaded in each class.

15 derivatives on the Hub, most of them quantized

From the Hugging Face model tree; quantized builds in teal, fine-tunes, merges and adapters in greys.

10 quantized (Hugging Face model tree)5 fine-tunes (Hugging Face model tree)10 quantized5 fine-tunes
10 quantized (Hugging Face model tree)5 fine-tunes (Hugging Face model tree)10 quantized5 fine-tunes

All variants →

Reference

Everything else, folded: the full tables, every source.

Use-case evidence

5 use cases

What it is good at 5 use cases

Labels are evidence, not verdicts: measured a third-party leaderboard row for this model; author-reported a number the model author published in the card or eval files; structural a deterministic signal from the name, config or chat template, or a decision-model estimate. Each chip links to its source. All use cases.

Facts

24 fields

Listed in LLMs

Facts

Pipeline tagimage-text-to-text
Librarytransformers
ArchitecturesGlm4vMoeForConditionalGeneration
Model typeglm4v_moe
Dtypebfloat16
Params by dtypeBF16: 107,710,927,360 · F32: 5,760
Size bandXXL
MoEyes
Experts128
Experts per token8
Context length65,536 (config.json max_position_embeddings)
Languageszh, en
PapersarXiv:2507.01006
LicenseMIT (mit)
Hub snapshot2026-10-25

Servability

vLLM · SGLang

Servability

vLLM: supported · Glm4vMoeForConditionalGeneration · 7050ef881ff0835f6890a47db1859a24c65481d6SGLang: supported · Glm4vMoeForConditionalGeneration · 773cb938fe9484a8f7e7e46fb1b1fe96412c59ed

vLLM registry (7050ef881ff0835f6890a47db1859a24c65481d6) · SGLang registry (773cb938fe9484a8f7e7e46fb1b1fe96412c59ed) · Matched by architecture class name against each project's registry on main; 'supported' means the architecture is registered, not that this checkpoint was tested.

Hardware fit

3 estimates

Hardware fit ESTIMATE

Weights-only memory for GLM-4.5V: params × bytes/param × 1.2 overhead. KV cache and activations are extra. How this is computed.

BF16 (2 bytes/param)259 GB · Multi-GPU node (<640 GB)
FP8 (1 byte/param)129 GB · Multi-GPU node (<640 GB)
INT4 (0.5 bytes/param)65 GB · Single high-end GPU (<80 GB)

Weights only (params × bytes/param × 1.2 overhead); KV cache and activations extra. MoE: all experts must be resident, so total parameters count.

All variants

15 variants

Lineage

Fine-tuned from zai-org/GLM-4.5-Air-Base (same organization) Family: zai-org/GLM-4.5V 15 derivatives on the Hub

Base model: zai-org/GLM-4.5-Air-Base

quantized: 10finetune: 5

Top variants (15 shown, ranked by downloads)

Relation
Quant
Size
15 rows
Variant Relation Quant Params Band License Author Likes Downloads
mradermacher/GLM-4.5V-i1-GGUF quantized GGUF — — mit mradermacher 1 231.8k
QuantTrio/GLM-4.5V-AWQ quantized AWQ 16.9B L mit QuantTrio 19 23.3k
mradermacher/GLM-4.5V-GGUF quantized GGUF — — mit mradermacher 1 8.4k
tiny-random/glm-4v-moe finetune — 5.85M S — tiny-random 2 4.3k
mlx-community/Huihui-GLM-4.5V-abliterated-mxfp4 quantized mxfp4 108B XXL mit mlx-community 3 2.9k
ggml-org/GLM-4.5V-GGUF quantized GGUF — — mit ggml-org 5 2.5k
INC4AI/GLM-4.5V-int4-AutoRound quantized int4 2.12B M — INC4AI 14 1k
mlx-community/GLM-4.5V-abliterated-8bit quantized -8bit — — mit mlx-community 1 1.5k
mlx-community/GLM-4.5V-abliterated-4bit quantized -4bit — — mit mlx-community 1 1.2k
mlx-community/Huihui-GLM-4.5V-abliterated-5bit quantized — — — mit mlx-community 0 1.1k
yujiepan/glm-4.5v-tiny-random finetune — 5.85M S — yujiepan 0 875
yujiepan/glm-4v-moe-tiny-random finetune — 5.85M S — yujiepan 0 857
turboderp/GLM-4.5V-exl3 quantized exl3 — — mit turboderp 5 220
zeromodels/glm-4.5v finetune — — — mit zeromodels 0 459
tiny-random/glm-4.5v finetune — 5.85M S — tiny-random 0 118

Repository changelog

13 commits

Repository changelog 13 commits

DateCommitSHA
2025-10-25 update for new format config of transformers lib / sglang lib ed47433
2025-10-25 Merge remote-tracking branch 'origin/main' 9081159
2025-10-25 update for new format config of transformers lib / sglang lib f33f585
2025-09-23 Update tokenizer_config.json 5b59df8
2025-08-18 update a78e5f2
2025-08-15 Improve model card: add detailed overview, expanded usage, and project updates (#7) 2fb7768
2025-08-12 paper 8a49973
2025-08-11 update readme dcfb7bf
2025-08-11 update 2a76d0e
2025-08-10 Add files using upload-large-folder tool 8a552c2
2025-08-10 Add files using upload-large-folder tool ce58144
2025-08-10 Add files using upload-large-folder tool ee8faeb
2025-08-10 initial commit 0974377

All providers

2 providers · 2 endpoints

Where to run 2 providers · 2 endpoints

Hosted endpoints observed for GLM-4.5V, sorted by input price (USD per million tokens). Each row names its observer and date; prices change daily, so check the source before quoting. Cheapest observed input price: $0.60/M.

ProviderModel refContextQuant$/M in$/M outtok/sTTFTToolsStatusObserved
Novita
hf, openrouter
zai-org/glm-4.5v 64K fp8 $0.60 $1.80 68 1258 ms yes live 2026-10-25
Z.ai
hf, openrouter
glm-4.5v 64K fp8 $0.60 $1.80 50.1 2142 ms yes live 2026-10-25

Articles and coverage

8 pieces

Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.

Official1

docs.nvidia.com314 words
GLM-4.5V is a 106B parameter vision-language model built on the GLM-4.5 Air architecture that supports a sequence length of 131,072 tokens. The model requires transformers version 4.57.1 or higher and utilizes 128 MoE experts with shared experts, activating ~12B parameters per token. It handles static images and video inputs through a pre-trained vision encoder integrated with Multi-Resolution Rotary Position Embedding, recommended on 32 nodes with 256 GPUs for LoRA/DoRA or 64 nodes with 512 GPUs for Full SFT.written, reviewed, cited

Analysis7

arxiv.orgauthority18,492 words
github.com2025-08-11authorityHN 27 pts · 0 comments2,069 words
ZhipuAI released the GLM-4.6V series, featuring a 106B foundation model and a 9B Flash variant optimized for local deployment. The 106B model scales its context window to 128k tokens and integrates native Function Calling capabilities for the first time in the series. Deployment supports SGLang (v0.5.15.post1+), vLLM (v0.25.0+), and Transformers (v0.5.13+).written, reviewed, cited
  • This repository will no longer be maintained as of 2026/09/02.
  • The GLM-4.5V model requires removing specific tags from its fine-tuning dataset.
  • GLM-4.1V-9B-Thinking outperforms Qwen-2.5-VL-72B on 18 tasks despite its smaller size.
localaimaster.com2026-05-022,369 words
GLM-4.5V is Zhipu AI's August 2025 open-weight vision-language MoE with 106B total parameters and 12B activated per token. The model achieves a ScreenSpot-Pro score of 56.4 and an OSWorld score of 35.8, outperforming dense alternatives on agentic GUI tasks. Production setups recommend 1x H100 80GB running FP8 for 50-70 tok/s, while self-hosters can use 2x RTX 3090 with INT4 AWQ.written, reviewed, cited
  • Engineers must use a llama.cpp build released after September 2025 to achieve full GLM-4.5V compatibility.
siliconflow.com494 words
GLM-4.5V is now available on SiliconFlow as a 100B-scale open-source vision reasoning model built on GLM-4.5-Air. It offers a 66K-token multimodal context window and costs $0.14/M tokens for input and $0.86/M tokens for output. The model features a Thinking Mode switch to balance quick responses with deep reasoning while using 3D convolution for video efficiency.written, reviewed, cited
paperium.net2026-02-08933 words
llm-stats.com2025-07-28416 words
ai-tldr.dev2025-08-11782 words

Papers

1 paper

Papers 1

arXiv links found in the model card and its tags. "Peer-reviewed" is shown only with evidence: a published venue in OpenAlex (measured) or the authors' own journal reference on arXiv (reported).

Similar models

3 models

Similar models

  • Qwen3.5-122B-A10B · 125B
    same size band (XXL), also MoE, same task (image-text-to-text), permissive license
  • Qwen3.8-Flash-Next · 180B
    same size band (XXL), also MoE, same task (image-text-to-text), fewer providers
  • Step-3.7-Flash · 201B
    same size band (XXL), also MoE, same task (image-text-to-text), permissive license

Sources

4 sources

Sources

Hub snapshot: 2026-10-25 · HF API: 2026-10-24 21:35 UTC · Providers: 2026-10-24 21:44 UTC · Articles: 2026-10-24 21:45 UTC · Summary: 2026-10-07 15:03 UTC · Last verified 2026-10-25

Follow GLM-4.5V

Watch this model

Email alerts are not open yet; the feeds above are the same data. See feeds for the item schema.