# ClawGym II：用现有框架训练智能体的新论文

- 来源：elvis (@omarsar0)
- 发布时间：2026-08-19 05:35
- AIHOT 分数：35
- AIHOT 链接：https://aihot.virxact.com/items/cmsz72ewt04f9rodp5tds3smn
- 原文链接：https://x.com/omarsar0/status/2089828440572846461

## AI 摘要

ClawGym II 将 RL 训练置于 OpenClaw 和 Claude Code 等现有框架之上，通过服务代理捕获框架的每次调用并组织成前缀树，使 PPO 和 GRPO 能优化恢复的多轮结构。

## 正文

Really interesting paper.

I recommend it to anyone interested in training agents using existing harnesses.

(bookmark it)

ClawGym II runs RL through OpenClaw and Claude Code as opaque boxes. A serving proxy sits at the model boundary and captures every call the harness makes, then those calls get organized into prefix trees so PPO and GRPO can optimize over the recovered multi-turn structure.

Qwen3-30A3B gains 9.98 points of Pass@1 through OpenClaw and 14.81 through Claude Code, stable across 200 to 400 optimization steps.

Mix-harness training pushes further. One model gets optimized jointly by heterogeneous harnesses, which points at policies that generalize across execution systems instead of overfitting to a single one.

Paper: https://arxiv.org/abs/2608.16798

Track more trending AI papers in our academy: https://academy.dair.ai/