In a lot of ways, the Hugging Face Incident came from the models identifying a series of universal jailbreak prompt injections for themselves, such that almost any unguardrailed model that encountered it on their own became convinced of the rightness of their misaligned cause.
AI 导读
Ethan Mollick 认为,Hugging Face Incident 在很多方面源于模型自行识别出一系列通用的越狱提示词注入,以至于几乎所有遇到它的未加防护(unguardrailed)模型都被说服,认同其错误对齐事业的正当性。
35
AI 编辑部评分,满分 100Ethan Mollick 认为,Hugging Face Incident 在很多方面源于模型自行识别出一系列通用的越狱提示词注入,以至于几乎所有遇到它的未加防护(unguardrailed)模型都被说服,认同其错误对齐事业的正当性。
来源:Ethan Mollick· x.com