Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Official3
blog.google2026-06-05officialauthorityHN front pageabout the gemma 4 familyHN 406 pts · 130 comments714 words
Google released new Gemma 4 checkpoints optimized with Quantization-Aware Training to improve efficiency on edge devices and consumer GPUs. The E2B model achieves a 1GB memory footprint using a mobile-specialized schema that applies targeted 2-bit quantization to token generation layers. Developers can access GGUF formats ready for llama.cpp and MTP QAT checkpoints to preserve inference speedups while running locally.written, reviewed, cited
- The mobile-specialized schema pre-calculates activation scaling settings during training to reduce workload on mobile chips.
- Targeted 2-bit quantization compresses token generation parts while keeping core reasoning layers at higher precision.
- Deploying only needed modalities allows the Gemma 4 E2B text-only model to require less than 1 GB of memory.
blog.google2026-05-05officialauthorityHN front pageabout the gemma 4 familyHN 687 pts · 330 comments796 words
Google released Multi-Token Prediction (MTP) drafters for the Gemma 4 family under the same open-source Apache 2.0 license as Gemma 4. These drafters deliver up to a 3x speedup for models like the 26B MoE and 31B Dense versions without quality degradation. Benchmarks on hardware such as the NVIDIA RTX PRO 6000 show that increasing batch sizes to 4 to 8 unlocks up to a ~2.2x speedup locally.written, reviewed, cited
- The MTP drafter shares the target model's KV cache to avoid recalculating context the larger model has already processed.
- For E2B and E4B edge models, an efficient clustering technique in the embedder accelerates generation where logit calculation is a bottleneck.
- The 26B mixture-of-experts model presents unique routing challenges at a batch size of 1 on Apple Silicon.
deepmind.google2026-04-02officialauthorityHN front pageabout the gemma 4 familyHN 1,812 pts · 474 comments253 words
Analysis7
github.com2026-07-29authorityHN front pageHN 919 pts · 342 comments2,408 words
TurboFieldfare enables Gemma 4 26B-A4B inference on Apple Silicon Macs with only 8 GB of RAM by streaming experts from the SSD instead of loading the full model. The runtime maintains ~2 GB of weights and a 4K KV cache in memory, achieving 5.1-6.3 tok/s on an 8 GB M2 MacBook Air and 31-35 tok/s on a 24 GB M5 Pro. The complete installation occupies about 14.3 GB for the text model plus optional image packs.written, reviewed, cited
- The installer never materializes the full source checkpoint and streams required byte ranges directly into the .gturbo layout.
- The loopback server has no remote authentication or TLS and the client must authorize and run every tool call.
- The image tower requires an M2 or newer Apple Silicon Mac while text-only inference remains available on M1.
neomindlabs.com2026-07-15HN front pageHN 329 pts · 212 comments1,937 words
Engineers can run Google's Gemma 4 26B-A4B model on a 13-year-old dual Xeon E5-2690 v2 server without a GPU by using the ik_llama.cpp fork with GGML_USE_IQK_MULMAT disabled. The system achieves approximately 5.2 tokens per second for decoding and 16 tokens per second for prompt evaluation when quantized to Q8_0. This repurposed HP StoreVirtual box costs under $300 and operates using only AVX1 instruction sets.written, reviewed, cited
- The graph builder emits MOE_FUSED_UP_GATE and FUSED_UP_GATE ops unconditionally even when AVX2 instructions are unavailable.
- Disabling --run-time-repack is mandatory because it reorders weights into an AVX2-only layout that garbles output on AVX1 hardware.
- The fix splits combined up_gate_exps tensors into two separate slices to run distinct mul-mat-IDs instead of relying on fused kernels.
github.com2026-07-22authorityHN front pageabout the gemma 4 familyHN 191 pts · 44 comments714 words
Cactus Hybrid introduces on-device models that score every answer with a confidence between 0 and 1 to decide when to hand off to a bigger model. The Gemma 4 E2B Hybrid model matches Gemini 3.1 Flash-Lite performance by routing only 15–55% of queries to the cloud while running the rest locally. It is MIT-licensed and achieves a 0.770 AUROC on MMLU, with a probe trained on zero audio data yet reaching 0.79–0.88 AUROC on four audio benchmarks.written, reviewed, cited
- Weights on the meta device crash the confidence read because probes score generations outside the module forward path.
- The probe is a patch you compile into the llama.cpp engine rather than a standalone library component.
- Transformers version 5.14 and above cause a segfault on this specific checkpoint.
github.com2026-08-27authorityabout the gemma 4 familyHN 18 pts · 0 comments722 words
xcancel.com2026-06-18about the gemma 4 familyHN 48 pts · 22 comments
apps.apple.com2026-04-05HN front pageabout the gemma 4 familyHN 868 pts · 234 comments
gizmoweek.com2026-04-15HN front pageabout the gemma 4 familyHN 303 pts · 187 comments364 words
