Chubby♨️@kimmonismus

2026-07-23 05:43· 1天前

AI 摘要

首个本地AI智能体在GAIA Level 1基准上以37个任务超越Hermes的31个。该Agent通过llama.cpp运行Qwen、Gemma和Llama模型，采用stable-prefix缓存降低长会话成本，TurboQuant技术将KV缓存缩小6.4倍。项目已开源，支持macOS、Windows和Linux。

The competition is intensifying！ The first local agent claims to be beating Hermes.

• Runs Qwen， Gemma， and Llama via llama.cpp • Stable-prefix caching keeps long sessions cheap • TurboQuant shrinks the KV cache by 6.4× • Solved 37 tasks vs. Hermes' 31

I'm a huge fan of open source. Therefore， I'm delighted to see significantly more competition here. Local and open source is the future.

Atomic AgentFirst local agent to beat Hermes on benchmarks! ✦ runs Qwen, Gemma, Llama via llama.cpp ✦ stable-prefix caching keeps sessions cheap ✦ TurboQuant cuts the KV-ca...

智能体开源/仓库开源生态端侧

在 X 查看原推导出 Markdown

Chubby♨️@kimmonismus · X

40导出 Markdown

2026-07-23 05:43·1天前

在 X 看原推· x.com

AI 摘要

The competition is intensifying！ The first local agent claims to be beating Hermes.

• Runs Qwen， Gemma， and Llama via llama.cpp • Stable-prefix caching keeps long sessions cheap • TurboQuant shrinks the KV cache by 6.4× • Solved 37 tasks vs. Hermes' 31

I'm a huge fan of open source. Therefore， I'm delighted to see significantly more competition here. Local and open source is the future.

Atomic AgentFirst local agent to beat Hermes on benchmarks! ✦ runs Qwen, Gemma, Llama via llama.cpp ✦ stable-prefix caching keeps sessions cheap ✦ TurboQuant cuts the KV-ca...