Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Official4
blog.google2026-06-03officialauthorityHN front pageabout the gemma familyHN 1,062 pts · 401 comments584 words
Google releases Gemma 4 12B, an Apache 2.0 licensed model that has crossed 150 million downloads and runs locally on hardware with 16GB of VRAM or unified memory. The encoder-free architecture integrates raw audio signals and vision inputs directly into the LLM backbone, eliminating separate encoders to reduce latency and memory usage. It includes Multi-Token Prediction (MTP) drafters to reduce inference latency while delivering reasoning performance nearing the 26B Mixture of Experts model.written, reviewed, cited
blog.google2026-06-05officialauthorityHN front pageabout the gemma familyHN 406 pts · 130 comments714 words
Google released new Gemma 4 checkpoints optimized with Quantization-Aware Training to improve efficiency on edge devices and consumer GPUs. The E2B model achieves a 1GB memory footprint using a mobile-specialized schema that applies targeted 2-bit quantization to token generation layers. Developers can access GGUF formats ready for llama.cpp and MTP QAT checkpoints to preserve inference speedups while running locally.written, reviewed, cited
- The mobile-specialized schema pre-calculates activation scaling settings during training to reduce workload on mobile chips.
- Targeted 2-bit quantization compresses token generation parts while keeping core reasoning layers at higher precision.
- Deploying only needed modalities allows the Gemma 4 E2B text-only model to require less than 1 GB of memory.
blog.google2026-05-05officialauthorityHN front pageabout the gemma familyHN 687 pts · 330 comments796 words
Google released Multi-Token Prediction (MTP) drafters for the Gemma 4 family under the same open-source Apache 2.0 license as Gemma 4. These drafters deliver up to a 3x speedup for models like the 26B MoE and 31B Dense versions without quality degradation. Benchmarks on hardware such as the NVIDIA RTX PRO 6000 show that increasing batch sizes to 4 to 8 unlocks up to a ~2.2x speedup locally.written, reviewed, cited
- The MTP drafter shares the target model's KV cache to avoid recalculating context the larger model has already processed.
- For E2B and E4B edge models, an efficient clustering technique in the embedder accelerates generation where logit calculation is a bottleneck.
- The 26B mixture-of-experts model presents unique routing challenges at a batch size of 1 on Apple Silicon.
deepmind.google2026-04-02officialauthorityHN front pageabout the gemma familyHN 1,812 pts · 474 comments253 words
Analysis6
github.com2026-07-29authorityHN front pageabout the gemma familyHN 919 pts · 342 comments2,408 words
TurboFieldfare enables Gemma 4 26B-A4B inference on Apple Silicon Macs with only 8 GB of RAM by streaming experts from the SSD instead of loading the full model. The runtime maintains ~2 GB of weights and a 4K KV cache in memory, achieving 5.1-6.3 tok/s on an 8 GB M2 MacBook Air and 31-35 tok/s on a 24 GB M5 Pro. The complete installation occupies about 14.3 GB for the text model plus optional image packs.written, reviewed, cited
- The installer never materializes the full source checkpoint and streams required byte ranges directly into the .gturbo layout.
- The loopback server has no remote authentication or TLS and the client must authorize and run every tool call.
- The image tower requires an M2 or newer Apple Silicon Mac while text-only inference remains available on M1.
neomindlabs.com2026-07-15HN front pageabout the gemma familyHN 329 pts · 212 comments1,937 words
Engineers can run Google's Gemma 4 26B-A4B model on a 13-year-old dual Xeon E5-2690 v2 server without a GPU by using the ik_llama.cpp fork with GGML_USE_IQK_MULMAT disabled. The system achieves approximately 5.2 tokens per second for decoding and 16 tokens per second for prompt evaluation when quantized to Q8_0. This repurposed HP StoreVirtual box costs under $300 and operates using only AVX1 instruction sets.written, reviewed, cited
- The graph builder emits MOE_FUSED_UP_GATE and FUSED_UP_GATE ops unconditionally even when AVX2 instructions are unavailable.
- Disabling --run-time-repack is mandatory because it reorders weights into an AVX2-only layout that garbles output on AVX1 hardware.
- The fix splits combined up_gate_exps tensors into two separate slices to run distinct mul-mat-IDs instead of relying on fused kernels.
apps.apple.com2026-04-05HN front pageabout the gemma familyHN 868 pts · 234 comments
gizmoweek.com2026-04-15HN front pageabout the gemma familyHN 303 pts · 187 comments364 words
gist.github.com2026-04-03authorityHN front pageabout the gemma familyHN 330 pts · 123 comments759 words
blog.danielvaughan.com2026-04-12HN front pageabout the gemma familyHN 285 pts · 116 comments
