A 395M-parameter reflex engine that plays Doom without a policy net
It replaces autoregressive LLM classification with a single parallel forward pass, cutting latency from seconds to sub-20 ms while staying local.

What it does
Von is a 395M-parameter bidirectional ModernBERT model that performs discrete decisions—classification, routing, guardrails, and ordinal scoring—in a single non-autoregressive forward pass. Instead of decoding text token-by-token, it scores options in parallel against a premise and emits calibrated probabilities and confidence intervals. It runs entirely offline across CUDA, ROCm, Metal, OpenVINO, or CPU and claims full compatibility with the TypeSafe System One protocol.
The interesting bit
The architecture deliberately prevents options from attending to each other, guaranteeing that shuffling the answer order cannot change the result—a flaw the authors note plagued v1.1 and most rival option-packing models. That same fixed-weight model can answer routing questions or, wired to a depth-buffer text renderer, control Doom zero-shot with no policy network or reinforcement-learning fine-tuning.
Key highlights
- Order-invariant option scoring via masked cross-option attention; v1.2 scores 0% answer flips under reordering on JevBench hard tier, down from 49.5% in v1.1.
- Sub-18 ms local inference on a GPU versus ~115 ms for the proprietary TypeSafe Jev API.
- Calibrated uncertainty via joint Cross-Entropy and Brier loss, with a fitted temperature of 1.1692.
- Three decision primitives:
decide(categorical),judge(binary probability), andrate(ordinal expectation). - Outperforms Jev on zero-shot ViZDoom combat (9.00 vs. 5.62 kills) and runs on Intel iGPUs via OpenVINO.
Caveats
- Still trails the proprietary TypeSafe Jev on the 49-task jabr v2 language-and-logic suite by a wide margin (72.0% vs. 96.6% macro accuracy).
- JevBench hard-tier accuracy sits at 38.7%, unchanged from v1.1, and the standard tier dipped slightly from 65.3% to 63.9%.
Verdict
Worth a look if you need deterministic, low-latency routing or guardrails on commodity hardware and are willing to trade generative flexibility for speed. If your use case demands state-of-the-art broad-domain reasoning or you are already satisfied with a cloud-hosted proprietary decision API, this is probably not your upgrade.
Frequently asked
- What is wfzyx/von?
- It replaces autoregressive LLM classification with a single parallel forward pass, cutting latency from seconds to sub-20 ms while staying local.
- Is von open source?
- Yes — wfzyx/von is open source, released under the Apache-2.0 license.
- What language is von written in?
- wfzyx/von is primarily written in Python.
- How popular is von?
- wfzyx/von has 588 stars on GitHub.
- Where can I find von?
- wfzyx/von is on GitHub at https://github.com/wfzyx/von.