On Oct 26, Ortet’s first health-model eval: 34 open-weight models on 50 tasks on Blackwell GPUs.
On Oct 26, Ortet’s first health-model eval: 34 open-weight models on 50 tasks on Blackwell GPUs.
Ortet published this on Oct 26, 2026 (source: ortet.ai).
Ortet published its first health-model evaluation, running 34 open-weight models on 50 health tasks and 15 public benchmarks on its Orion NVIDIA Blackwell cluster and comparing them with ten API models. It finds open models near closed frontier systems on basic medical knowledge, with a clearer gap on hard clinical cases and patient-prediction tasks, and reports that about 10% of items can reproduce full-set rankings.
Items older than 72 hours never go in Top stories and show their original date.