OpenBMB@OpenBMB
56AI 编辑部评分,满分 100

面壁智能等发布 SciDC:规则约束减少模型幻觉

2026-08-14 22:00· 29分钟前
AI 导读

面壁智能(OpenBMB)联合清华NLP、南京大学等发布 SciDC,将科学知识转化为解码约束,使本地部署的领域模型只能在专家规则定义的可行域内生成。该方法无需微调,在工业配方设计、临床诊断等任务上平均准确率提升 +11.6(Qwen3-4B 42.5→54.1,Qwen3-14B 51.4→63.0),真实医疗记录上 Qwen3-14B 精确匹配从 33.5% 提升至 45.1%。

LLMs know a lot and sound convincing-yet in clinical diagnosis, chemical synthesis, or industrial formulation they still hallucinate, inventing reasoning that violates guidelines or even basic physics. Scientific rules guide human experts beautifully, so why can't a model actually use them?

Introducing SciDC, from @TsinghuaNLP (OpenBMB member) with Nanjing University and Northeastern University. It turns flexible scientific knowledge into decoding constraints-so a locally-deployed domain model can only generate within the feasible region defined by expert rules.

1⃣️ Knowledge becomes constraints, not prompts. A strong general LLM (GLLM) acts as a one-time knowledge compiler, parsing a natural-language knowledge document into standardized, executable rules; a smaller domain LLM (DLLM) then generates under those rules-keeping domain data local for privacy and cutting adaptation cost.

2⃣️ Three layers of control. Top-layer rules govern macro reasoning structure (enforce a step sequence, e.g. extract findings before diagnosing); middle-layer rules enforce conditional multi-hop logic with dynamic backtracking when inconsistencies appear; bottom-layer rules mask decoder logits at the token level to guarantee syntactic and numerical feasibility.

3⃣️ +12% on average, no tuning. Across industrial formulation design, clinical tumor diagnosis, and retrosynthesis, SciDC lifts overall accuracy by +11.6 for both Qwen3-4B (42.5→54.1) and Qwen3-14B (51.4→63.0)-with no parameter tuning or hand-crafted edits, just the knowledge document.

4⃣️Harder tasks, bigger gains. On real (not simulated) medical records Qwen3-14B jumps 33.5%→45.1% exact match, reaching 70%+ with light expert prompting; even the domain model ChemDFM improves retrosynthesis hit@1 from 16.2%→29.0%-showing rules and domain knowledge are synergistic, not redundant.

arXiv: https://arxiv.org/abs/2604.06603 Code: https://github.com/Maotian-Ma/SciDC #AI #THUNLP #OpenBMB #LLM #AI4Science #Hallucination #NLP

来源:OpenBMB · x.com

面壁智能等发布 SciDC:规则约束减少模型幻觉

OpenBMB · @OpenBMB · X·2026-08-14 22:00·29分钟前
AI 导读

面壁智能(OpenBMB)联合清华NLP、南京大学等发布 SciDC,将科学知识转化为解码约束,使本地部署的领域模型只能在专家规则定义的可行域内生成。该方法无需微调,在工业配方设计、临床诊断等任务上平均准确率提升 +11.6(Qwen3-4B 42.5→54.1,Qwen3-14B 51.4→63.0),真实医疗记录上 Qwen3-14B 精确匹配从 33.5% 提升至 45.1%。

LLMs know a lot and sound convincing-yet in clinical diagnosis, chemical synthesis, or industrial formulation they still hallucinate, inventing reasoning that violates guidelines or even basic physics. Scientific rules guide human experts beautifully, so why can't a model actually use them?

Introducing SciDC, from @TsinghuaNLP (OpenBMB member) with Nanjing University and Northeastern University. It turns flexible scientific knowledge into decoding constraints-so a locally-deployed domain model can only generate within the feasible region defined by expert rules.

1⃣️ Knowledge becomes constraints, not prompts. A strong general LLM (GLLM) acts as a one-time knowledge compiler, parsing a natural-language knowledge document into standardized, executable rules; a smaller domain LLM (DLLM) then generates under those rules-keeping domain data local for privacy and cutting adaptation cost.

2⃣️ Three layers of control. Top-layer rules govern macro reasoning structure (enforce a step sequence, e.g. extract findings before diagnosing); middle-layer rules enforce conditional multi-hop logic with dynamic backtracking when inconsistencies appear; bottom-layer rules mask decoder logits at the token level to guarantee syntactic and numerical feasibility.

3⃣️ +12% on average, no tuning. Across industrial formulation design, clinical tumor diagnosis, and retrosynthesis, SciDC lifts overall accuracy by +11.6 for both Qwen3-4B (42.5→54.1) and Qwen3-14B (51.4→63.0)-with no parameter tuning or hand-crafted edits, just the knowledge document.

4⃣️Harder tasks, bigger gains. On real (not simulated) medical records Qwen3-14B jumps 33.5%→45.1% exact match, reaching 70%+ with light expert prompting; even the domain model ChemDFM improves retrosynthesis hit@1 from 16.2%→29.0%-showing rules and domain knowledge are synergistic, not redundant.

arXiv: https://arxiv.org/abs/2604.06603 Code: https://github.com/Maotian-Ma/SciDC #AI #THUNLP #OpenBMB #LLM #AI4Science #Hallucination #NLP

来源:OpenBMB· x.com