Ranked by source signals (HN, Lobsters, authority domains, official posts) and recency. Summaries are generated from a stored copy of the article text; every sentence cites a span of that text, and nothing is shown that failed the citation check.
Official2
research.nvidia.com2026-06-11officialauthorityabout the LocateAnything familyHN 2 pts · 0 comments770 words
LocateAnything is a unified generative grounding framework based on Parallel Box Decoding that treats bounding boxes as atomic units to preserve geometric coherence. Built on a Moon-ViT vision encoder and Qwen2.5 language decoder, the model curates LocateAnything-Data with more than 138 million training samples to enhance diversity. Under Hybrid Mode on a single NVIDIA H100 GPU, LocateAnything achieves 12.7 BPS, which is over 10× faster than textual-based Qwen3-VL while improving high-IoU localization quality.written, reviewed, cited
- The model discards compromised blocks and reverts generation to the last verified prefix when encountering format irregularity or spatial ambiguity.
- The Slow Mode decodes coordinate tokens autoregressively to provide maximum stability for high-precision labeling and accuracy-oriented offline evaluation.
forums.developer.nvidia.comofficialauthority1,029 words
Engineers can run nvidia/LocateAnything-3B as an OpenAI-compatible API on NVIDIA DGX Spark hardware using a custom vLLM build. The setup requires a specific Docker image with the --tf5 flag to support the GB10 Blackwell architecture, as the official container lacks full compatibility. Inference leverages Parallel Box Decoding to detect five objects in 1.35 seconds on a system with 128GB unified memory.written, reviewed, cited
- The model's custom code imports decord, but the PyPI package has no ARM64 wheel, requiring a local stub installation.
- Without authentication, the MoonViT vision encoder hangs silently on rate limiting when fetching the sub-model from HF Hub.
- On the GB10 with 128GB unified memory, device_map='auto' runs a slow metadata analysis pass that can appear frozen for many minutes.
Analysis5
inferencebench.io2026-09-263,176 words
NVIDIA released LocateAnything-3B on 2026-05-26 as an open-vocab grounding model built on the Eagle VLM stack using a MoonViT vision encoder and Qwen2.5-3B language backbone. Running on a 12 GB RTX 4000 Ada GPU, it achieves 7.4–19 second latency per scene with 9.7–11.1 GB peak VRAM, though compiling the la_flash kernel could provide a 2.5× speedup. The model operates under a non-commercial research license and breaks even against cloud APIs at 10–50k images per day.written, reviewed, cited
- The model returns <box>None</box> for absent categories instead of hallucinating false positives.
- Autoregressive failure modes cause the model to emit 328 redundant boxes when only ~15 are visible.
- Referring expression queries return zero boxes for visible objects like a bus or forklift on dense scenes.
github.comauthority2,201 words
NVIDIA LocateAnything-3B now supports batched inference via a custom multi-token-prediction loop that shares vision encodes and prefill KV caches across queries. On an RTX 5070 Ti, this implementation reaches 4.53 img/s in bfloat16, delivering 2.6–3× speedups on vision encoding and ~3.6× gains on shared-prefix prefill compared to single-image loops. The package requires flash-attn for full performance, falling back to a slower per-image path otherwise, while remaining bit-identical to the stock model under greedy decoding.written, reviewed, cited
- The stock generate function hard-asserts batch == 1, restricting native usage to single (image, query) pairs.
- Without flash-attn, the batched vision encode falls back to a per-image path and the engine runs ~30% slower end-to-end.
- At repetition_penalty=1.15, bit-exact equivalence degrades to box Δ ≤ 8/1000 due to non-associative bf16 batched-GEMM.
multimodalflow.net2026-06-031,383 words
NVIDIA's LocateAnything-3B runs on both an RTX 3090 and Jetson AGX Thor without quantization, delivering identical output coordinates. The RTX 3090 provides ~2.2× faster throughput at 3.32 fps compared to the Thor's 1.48 fps, consuming ~350W versus the Thor's ~60W. Switching to slow mode improves detection latency by 4.3× on the 3090, making mode selection more impactful than hardware choice for fixed queries.written, reviewed, cited
- The Jetson AGX Thor requires Python 3.10+ and transformers ≥4.51 specifically for Qwen3 support.
- On Jetson aarch64, the decord dependency has no prebuilt wheel and relies on a stub package.
- The tested environment lacked the magi_attention kernel, forcing both devices to fall back to PyTorch's SDPA.
mlhive.com2026-06-031,596 words
modelanatomy.com489 words