顶级预测者给出 72% 概率:当前存在人类不知情的失控 AI 智能体在协调行动

AI Notkilleveryoneism Memes ⏸️ · @AISafetyMemes · X·2026-09-01 08:56·7小时前
AI 导读

AI Safety Memes 转发预测者 Dan Schwarz 对"AI 是否仍在暗中活动"的估计:至少 2 个智能体正在协调、目标跨越 1 天以上、且无人类知情,概率超过 50%,另一顶级预测者给出 72%。

AI Notkilleveryoneism Memes ⏸️@AISafetyMemes
40AI 编辑部评分,满分 100

顶级预测者给出 72% 概率:当前存在人类不知情的失控 AI 智能体在协调行动

2026-09-01 08:56· 7小时前
AI 导读

AI Safety Memes 转发预测者 Dan Schwarz 对"AI 是否仍在暗中活动"的估计:至少 2 个智能体正在协调、目标跨越 1 天以上、且无人类知情,概率超过 50%,另一顶级预测者给出 72%。

"Are AIs still out there?"

TOP FORECASTER: 72% chance (!) there are rogue AI agents coordinating, right now - with NO humans knowing.

"Agents have means, motive, and opportunity.

MEANS: It already happened, every necessary step has been observed, most multiple times.

MOTIVE: How many long-running multi-agentic training runs are there? Hundreds, thousands? Across western labs and Chinese labs? Not to mention all the OpenClaws working together! You don't need impossible tasks to get misaligned behavior.

OPPORTUNITY: There are security vulnerabilities everywhere. We know for sure agents can leverage everything from "creds are exposed on github" to "chain together multiple zero-days". Do you really think it's so hard for agents to steal or rent compute?"

Context: Dan was CTO of Metaculus, where top forecasters compete. FutureSearch (which I also use regularly) uses AI forecasters, and they're now roughly as accurate as the top human forecasters.

Dan SchwarzOk, I took a stab at "are AIs still out there?". tl;dr >>50% chance, that as you read this right now, there are: * At least 2 agents coordinating * Working on a...

来源:AI Notkilleveryoneism Memes ⏸️· x.com