eric zakariasson@ericzakariasson · 6天前68http://x.com/i/article/2070417295810166784
# Human in the /loop
What I like most about coding with agents right now is the room to leave a few runs going and still get on with other work. When something finishes or needs a call, I show up.
This post is a short explainer of the setup I use, a definition of done the agent can score, a loop that keeps going until it should stop, pings so I know when to lean in.
## Find something the agent can verify
Before kicking off a longer running task, I lock a definition of done. Examples I actually use:
- Model or eval work. Target is a score. Change the approach, run the eval, keep the change only if the number moved the right way. Closest to Karpathy's autoresearch for ML training loops.
- Web app or UI. Target is a QA pass. Load the page or run Playwright, screenshot it, make sure it still does the thing.
- Backend or refactor. Target is the test suite. Failing tests first, then green, and it has to stay green.
- Speed or flakiness. Target is a number (p95, a benchmark). Change and measure until you're under the line you set.
- Data or content cleanup. Target is a count. Loop until zero rows fail validation, or every item passes the check.
Writing the loop is mostly writing how you'd check the work yourself. Some tasks need every step on the page. Others I give a goal and a rough direction and let the model fill in the middle. I start more explicit than I think I need, then loosen it once I see what it can infer.
## Wrap it in a loop
Definition of done in hand, I tell the agent to loop on it. Change something, measure, keep or revert, go again. Doesn't have to be one tiny edit each time. The step just has to be measurable against the target. I care most about the stop conditions, which might be
- Metric hits the target
- No improvement after a few tries
- Out of ideas
- Blocked or unsure (stop and ask)
## Get pinged instead of babysitting
So the agent gets a notify path (MCP plus /notify) and reaches me there. Usually Slack, because that's where everything else already is. Same setup could be iMessage or whatever. I treat it as a generic notification channel, not full Slack access for the agent. Status updates and "I need a decision" show up like normal messages. When I answer, that reply is the next thing the loop runs on.
## Run it in the cloud
Most of this doesn't stay on my laptop. It runs in the cloud so a loop can keep going for hours without my machine being open. I use my own client as the orchestrator and fan work out to cloud agents from there.
## Then start the next one
Once a loop is running, I start another. Usually three or so, sometimes five. And that's only the long loops. I often have other agents up at the same time on shorter work: a PR, a one-off investigation, something that isn't a multi-hour hill climb. If things are quiet I fire off another. If three are waiting on me I stop starting stuff and go review.
## Prompting
Rough template of how i prompt. /loop drives the iterations and /notify keeps me posted
If you're running loops, I'd love to hear how we can make it easier for you!
译Eric Zakariasson 分享其AI智能体编程工作流：先设定可验证的完成标准（如模型评估分、测试全绿、p95阈值等），再将任务包装成循环——智能体反复修改、测量、保留或回退，直到达标、多轮无改进、思路用尽或遇阻。通过MCP和/notify向Slack发送通知，需要决策时主动联系人类。循环在云端运行，可同时启动多个长循环，并穿插PR、一次性调查等短任务。提示词模板用/loop驱动迭代、/notify保持更新。
meng shao@shao__meng