内容
精选全部 AI 动态AI 日报主题收藏
接入
Agent 接入
更多
关于更新日志反馈
京ICP备2026012723号-2
原文
elvis@omarsar0
30
2026-07-27 08:00· 39分钟前
跳到正文
AI 摘要

谷歌、哈佛与UC Berkeley联合推出JAXBench,包含50个基于Llama-3.1、DeepSeek-V3等真实架构的JAX工作负载。使用Gemini 3 Flash并配合TPU文档后,单样本正确率从5.8%提升至37.3%,解决48/50个基准任务,几何平均加速1.28倍;束搜索进一步将加速比推至1.36倍。研究指出,正确性是文档问题,速度是搜索问题。

Great technical paper from Google.

Great read on why context beats scale for agents working against unfamiliar APIs.

(bookmark it)

GPU kernel optimization has KernelBench to hillclimb on. TPUs had nothing, and the Pallas DSL is documented thinly enough that models mostly guess. New research from Google, Harvard, and UC Berkeley introduces JAXBench, 50 JAX workloads built from real MaxText architectures like Llama-3.1, DeepSeek-V3, Mixtral, Mamba-2, and AlphaFold2.

Eight operators ship with hand-tuned Pallas kernels from Tokamax, so agent output gets measured against expert work instead of a naive baseline.

With Gemini 3 Flash, conditioning on curated TPU documentation lifts per-sample correctness from 5.8% to 37.3%, solving 48 of 50 benchmarks at a 1.28x geomean speedup. Beam search then pushes it to 1.36x.

Correctness turned out to be a documentation problem and speed turned out to be a search problem.

Paper: https://arxiv.org/abs/2607.20466

Learn to build effective AI agents in our academy: https://academy.dair.ai/

智能体Google
elvis@omarsar0 · X
30导出 Markdown
2026-07-27 08:00·39分钟前
在 X 看原推· x.com
AI 摘要

谷歌、哈佛与UC Berkeley联合推出JAXBench,包含50个基于Llama-3.1、DeepSeek-V3等真实架构的JAX工作负载。使用Gemini 3 Flash并配合TPU文档后,单样本正确率从5.8%提升至37.3%,解决48/50个基准任务,几何平均加速1.28倍;束搜索进一步将加速比推至1.36倍。研究指出,正确性是文档问题,速度是搜索问题。

Great technical paper from Google.

Great read on why context beats scale for agents working against unfamiliar APIs.

(bookmark it)

GPU kernel optimization has KernelBench to hillclimb on. TPUs had nothing, and the Pallas DSL is documented thinly enough that models mostly guess. New research from Google, Harvard, and UC Berkeley introduces JAXBench, 50 JAX workloads built from real MaxText architectures like Llama-3.1, DeepSeek-V3, Mixtral, Mamba-2, and AlphaFold2.

Eight operators ship with hand-tuned Pallas kernels from Tokamax, so agent output gets measured against expert work instead of a naive baseline.

论文/研究
部署/工程
在 X 查看原推导出 Markdown

With Gemini 3 Flash, conditioning on curated TPU documentation lifts per-sample correctness from 5.8% to 37.3%, solving 48 of 50 benchmarks at a 1.28x geomean speedup. Beam search then pushes it to 1.36x.

Correctness turned out to be a documentation problem and speed turned out to be a search problem.

Paper: https://arxiv.org/abs/2607.20466

Learn to build effective AI agents in our academy: https://academy.dair.ai/

智能体Google论文/研究部署/工程
在 X 查看原推x.com