soniqo.audio2026-09-27about the GLiNER2.5 familyHN 4 pts · 0 comments1,583 words
GLiNER2.5-Decide is a 340M-parameter DeBERTa-v3-large encoder released under Apache-2.0 that runs natively on Macs via MLX Swift. Jev is TypeSafe's hosted API costing $42 per billion input tokens, supporting up to 64k tokens per request with mixed question types. Benchmarks show GLiNER achieving 38.3 ms p50 latency on a V100, while Jev evaluates typed questions against state in parallel without generating text.written, reviewed, cited
- The Swift port rejects inputs longer than 512 encoded tokens per request.
- JevK5 is an open reproduction using a 4B-class Qwen3.5 decoder, not TypeSafe's commercial model.
- INT8 quantization requires a third of the FP32 memory while keeping confidence within 0.006.