‹ All rumors

Did Tsinghua open-source AKV, a KV cache engineering server for LLM agents on SGLang?

ReportedLast checked
TsinghuaFirst seen

Verdict

Yes, per MarkTechPost. The outlet reports agents can drop and reposition KV cache instead of summarizing history, cutting average inference cost ~27.7% in tests.

Evidence timeline · 1 source · newest first
  1. Reported

    MarkTechPost reports that Tsinghua and CUHK researchers open-sourced AKV, an Apache-2.0 SGLang-based serving system that lets agents drop and reposition KV cache instead of summarizing history, cutting average inference cost about 27.7% and raising average task score about 1.7 points across tested models.

    Source: MarkTechPost
Quick answers
Is AKV KV cache server out yet?
No. Tsinghua has not announced it as of Oct 26.
When is AKV KV cache server expected?
No official release date as of Oct 26.
How we label rumors
Unconfirmed
Circulating with at least one public source we can link to; no official confirmation.
Reported
Reported by a news outlet; not confirmed by the company.
Confirmed
Confirmed by the company or another official source.
Debunked
Denied by the company, retracted by the original source, or shown to be false by the evidence.

We record what sources show, with dates. We don't predict or score how likely a rumor is.

DailyCitedRSSAboutPrivacy