OpenBMB@OpenBMB

2026-06-24 21:00·8天前

AI 摘要

面壁智能 OpenBMB 联合清华NLP、哈工大、东北大学提出元认知框架 Know More, Know Clearer，应对 LLM 因认知错位导致的幻觉。框架包含三项：结构性衰减定律（准确率随不确定性指数衰减）；Know More（CGKE）将知识空间分为掌握/混淆/缺失三区针对性增强；Know Clearer（CDKC）基于 GRPO 对齐置信度，使平均 ECE 从 60.41 降至 24.34。在 11 个 QA 基准上，CDKC 将 Llama-3.1-8B 从 30.91% 提升至 55.50%（+24.59 点），Qwen2.5-7B 从 25.76% 提升至 48.29%（+22.53 点）。自知识基准上 CBS 达 73.43%、CAE 达 68.18%，正确决策率 63.37%，边界识别 79.07%，达到最佳平衡。

LLMs don't just hallucinate because they lack knowledge-they hallucinate because they don't know what they don't know. Existing knowledge augmentation blindly injects more data， treating every error as a knowledge gap. But overconfident wrong answers and uncertain correct ones reveal a deeper problem： cognitive misalignment. 🤔 Today， we dive into Know More， Know Clearer-a meta-cognitive framework by @TsinghuaNLP （OpenBMB member） alongside researchers from Harbin Institute of Technology and Northeastern University. The team proposes a unified system that diagnoses a model's cognitive state and applies targeted intervention-not indiscriminate knowledge stuffing. 📄 arXiv： https://arxiv.org/abs/2602.12996 🤗 Paper： https://huggingface.co/papers/2602.12996

Why it matters：

1⃣️ The Structural Decay Law： A Universal Foundation： The team discovers that accuracy exhibits a stable exponential decay relative to uncertainty： E【Acc|U】 ≈ a·exp（−U） + b. Validated across 6 architectures （Qwen， Llama， Mistral）， this proves internal confidence signals structurally encode performance-not random noise-providing a rigorous basis for meta-cognitive optimization. 2⃣️ Know More （CGKE）： Differentiated， Not Indiscriminate： Rather than uniform knowledge injection， the framework partitions the knowledge space into Mastered， Confused， and Missing regions via self-sampled behavioral profiling. Each region receives a tailored augmentation strategy-boundary expansion， structural disambiguation， or epistemic foundation-targeting exactly where the model needs it most. Ablation shows removing the "Confused" category causes the largest performance drop. 3⃣️ Know Clearer （CDKC）： Aligning Confidence with Correctness： A cognitive consistency alignment mechanism built on GRPO actively recalibrates the model's confidence landscape-sharpening distributions on correct paths， dispersing them on incorrect ones. Result： average ECE drops from 60.41 to 24.34， and the model learns to genuinely know its own limits rather than learning to refuse everything. 4⃣️ Results： 24.59-Point Gain and True Self-Knowledge： On 11 QA benchmarks， CDKC （2-round） lifts Llama-3.1-8B from 30.91% to 55.50% （+24.59 pts） and Qwen2.5-7B from 25.76% to 48.29% （+22.53 pts）. On self-knowledge benchmarks， the framework achieves a CBS of 73.43% and CAE of 68.18%-delivering 63.37% correct answering decisions while maintaining 79.07% boundary recognition， the best balance of any method tested. Knowledge augmentation is not merely about knowing more-it's about knowing more clearly. This framework sets a new standard for reliable， calibrated knowledge in LLMs. #AI #THUNLP #OpenBMB #LLM #KnowledgeAugmentation #Hallucination #MetaCognition #NLP

OpenBMB@OpenBMB · X

36导出 Markdown

2026-06-24 21:00·8天前

在 X 看原推· x.com

AI 摘要