"In the Weights"网站可查AI模型是否知道你是谁
阅读原文· the-decoder.com网站 In the Weights 通过查询多个大语言模型,判断特定人物是否出现在模型的权重中——即模型训练时认为该人物足够重要而记住。网站聚合结果并给出强度评分,最高分996对应莫扎特、莎士比亚、泰勒·斯威夫特等名流。由两位前OpenAI员工Joey Flynn和Thomas Dimson创建。较小模型更难出现,因此能在Meta的10亿参数模型Llama中出现的人被视为高度相关。网站也指出了LLM的明显局限:模型可能幻觉传记细节、拼写错误会降低分数、常见姓名结果通常较差。
Website "In the Weights" shows whether AI models know who you are
The site In the Weights reveals which people are "stored" in the weights of large language models. Those "weights" are billions of numerical values where AI models encode their knowledge. If you show up in them, the model considered you relevant enough during training to recall without tools like web search.
The site queries several models to figure out who a specific person is, combines the results, and assigns a strength score. My colleague Maximilian Schreiner and I currently have strength scores of 175 and 262, for example. According to the leaderboard, the maximum strength score is 996, reserved for names like Mozart, Shakespeare, or Taylor Swift.
The site was built by Joey Flynn and Thomas Dimson, both former OpenAI employees. According to the creators, smaller models make it harder to show up in results. So anyone who appears in Meta's Llama, which has a billion parameters, counts as highly relevant. The creators also flag the obvious limits of LLMs, like that models can hallucinate biographical details, typos drag down scores, and common names often produce worse results.

