# ClawGym II：黑盒 RL 训练智能体提升基准分数

- 来源：Rohan Paul (@rohanpaul_ai)
- 发布时间：2026-08-22 22:28
- AIHOT 分数：37
- AIHOT 链接：https://aihot.virxact.com/items/cmt4htp1o1lrcro6tx2ego674
- 原文链接：https://x.com/rohanpaul_ai/status/2091170526744240609

## AI 摘要

ClawGym II 框架将 OpenClaw 或 Claude Code 作为黑盒纳入 RL 训练循环，无需访问其内部机制。通过 Qwen3-30A3B，该方法在 ClawGym-Bench Pass@1 上经 OpenClaw 提升 9.98 分、经 Claude Code 提升 14.81 分，混合训练亦有效，并扩展至 JobBench 和 OfficeQA。

## 正文

You can now RL-train an agent through the same complex harness it will actually run in, without needing access to the harness internals.

ClawGym II shows that Claude Code or OpenClaw can be treated as a black box and still become part of the RL training loop.

The framework runs OpenClaw or Claude Code unchanged inside sandboxes, intercepts model calls at the serving boundary, and rebuilds fragmented calls into prefix-tree trajectories that PPO or GRPO can optimize.

That lets the model learn through the harness without the training stack reproducing its tool routing, retries, context management, or subagents.

With Qwen3-30A3B, this raised ClawGym-Bench Pass@1 by 9.98 points through OpenClaw and 14.81 points through Claude Code.

Mix-harness training also worked: a policy trained from OpenClaw and Claude Code matched or slightly beat the corresponding single-harness models under both execution systems.

The paper also reports gains on JobBench and OfficeQA, so the setup extends beyond ClawGym-style tasks.

– arxiv. org/abs/2608.16798

Title: "ClawGym II: Exploring Black-Box RL on Agent Harness"