论文提出用生产流量驱动的后训练将 200+ 内部应用流量整合到单一自托管 LLM

HuggingFace Daily Papers(社区热门论文)·2026-09-01 08:00·2天前
AI 导读

一篇 arXiv 论文提出在数据驻留约束下,将超过 200 个内部应用的流量整合到单个自托管模型,通过生产错误分析沿指令遵循、函数调用和内部任务分布三个轴弥补质量差距。

HuggingFace Daily Papers(社区热门论文)
37AI 编辑部评分,满分 100

论文提出用生产流量驱动的后训练将 200+ 内部应用流量整合到单一自托管 LLM

2026-09-01 08:00· 2天前
AI 导读

一篇 arXiv 论文提出在数据驻留约束下,将超过 200 个内部应用的流量整合到单个自托管模型,通过生产错误分析沿指令遵循、函数调用和内部任务分布三个轴弥补质量差距。

Data-residency constraints force enterprises to self-host LLMs, but continuous adoption of newer models without decommissioning their predecessors expands the serving fleet, fragmenting a finite GPU pool. We consolidate traffic from over 200 internal applications onto a single model by closing quality gaps identified through production error analysis along three axes: instruction following, function-calling, and internal task distribution. Quality is tracked by offline benchmarks stratified to production traffic and scored by deterministic verifiers or calibrated LLM judges. Rather than optimising all objectives jointly, which introduces cross-domain reward interference, we train a separate GRPO expert per axis and merge them via two-stage SLERP. Each expert's reward exposes a distinct failure mode, namely semantic collapse, over-calling, and verbosity hacking, each requiring a domain-specific fix. In non-reasoning mode the recipe surpasses a {sim}7times larger by total parameters baseline on the in-house Arena with 69.6 to 65.8, instruction following with 0.85 to 0.83, and function-calling with 0.79 to 0.77, while lifting general dialogue benchmarks. The model absorbs 50% of platform traffic, 116M requests per month, at a fraction of the serving cost.

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org