Daily AI news, sourcedWhere it stands
As of Oct 12, shad0w is an open-source Apache-2.0 tool for Python, JS and C that sits in front of any OpenAI-compatible server, including Ollama, logs the model's answers and, after about 1,000 of them, compiles a small table that answers repeat classification queries on CPU in about 2.4 microseconds.
- Official
shad0w learns a local LLM's classification answers and serves the repeats in microseconds
Shad0w published this on Oct 12, 2026 (source: 2796gaurav.github.io).
shad0w is an open-source Apache-2.0 tool for Python, JS and C that sits in front of any OpenAI-compatible server, including Ollama, logs the model's answers and, after about 1,000 of them, compiles a small table that answers repeat classification queries on CPU in about 2.4 microseconds. It only answers where it matches the model at least 95% of the time on held-out answers and sends everything else to the LLM; on its benchmarks it handled 61 to 94% of messages.
Source: shad0w
- Official
- An institution announces something that has already happened, through its own channel or a founder or executive account.
- Statement by …
- A named person's views, predictions, plans or comments, including remarks reported by media when the original is unavailable.
- Reported by …
- Only media or another third party is saying it. We name the outlet.
- Unconfirmed
- Circulating online (posts, comments, leaks). No company, named person or outlet has confirmed it.
Items older than 72 hours never go in Top stories and show their original date.