Home / Measurements

INDEPENDENT VERIFICATION

Measured means we actually ran a protocol.

Publisher benchmarks stay publisher claims. Weight-memory estimates stay OMW-derived estimates. The “OMW measured” class is reserved for explicit execution results with protocol, timestamp and evidence.

0 OMW measurements11 selected execution targetsNo synthetic benchmark claimsNo universal ranking

Measurements API ↗Evidence classes →

CURRENT MEASUREMENT STATE

No independent runtime result is claimed yet.

The current production pipeline has no execution backend for heavyweight model inference. OMW therefore keeps these values unknown instead of relabeling publisher claims or estimates as measurements.

SELECTED TARGETS

Models queued for explicit execution.

Selection follows the existing curated Leading discovery set and is not a universal quality ranking.

MiniMax-M3pending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

K2-Horizon-375B-A23Bpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

MiMo-V2.6-Pro-RLpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

GLM-5.3pending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

Kimi-K3pending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

GLM-5.3-Flashpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

DeepSeek-V4.1-Flashpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

Qwen3.8-27Bpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

Inklingpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16pending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput

Muse-Glimmer-30Bpending execution backend

No measurement is claimed until an execution backend records a protocol result.

runtime-smoke, observed-peak-memory, context-smoke, throughput