Bridgewater与Thinking Machines Lab微调Qwen3-235B,金融文档分析超越GPT和Claude

The Decoder:AI News(RSS)·2026-07-03 19:16·60天前·Maximilian Schreiner
AI 导读

对冲基金Bridgewater与Thinking Machines Lab微调开源模型Qwen3-235B用于金融文档分析。内部评测显示,微调模型准确率达84.7%,而最佳前沿模型(Gemini、Claude、GPT变体)仅为78.2%,且运行成本低近14倍。前沿模型在基础提示下准确率仅约50%,加入专家指令和三档评级系统也未能突破80%阈值。Bridgewater利用内部专家知识纠正承包商标签错误,通过Tinker平台训练。这表明企业可利用专有数据开发强大AI方案,无需与大型提供商共享敏感信息。

The Decoder:AI News(RSS)
54AI 编辑部评分,满分 100

Bridgewater与Thinking Machines Lab微调Qwen3-235B,金融文档分析超越GPT和Claude

2026-07-03 19:16· 60天前· Maximilian Schreiner
AI 导读

对冲基金Bridgewater与Thinking Machines Lab微调开源模型Qwen3-235B用于金融文档分析。内部评测显示,微调模型准确率达84.7%,而最佳前沿模型(Gemini、Claude、GPT变体)仅为78.2%,且运行成本低近14倍。前沿模型在基础提示下准确率仅约50%,加入专家指令和三档评级系统也未能突破80%阈值。Bridgewater利用内部专家知识纠正承包商标签错误,通过Tinker平台训练。这表明企业可利用专有数据开发强大AI方案,无需与大型提供商共享敏感信息。

Image description

Key Points

  • Bridgewater and Thinking Machines Lab have trained an open-source AI model for analyzing financial documents that outperforms leading commercial models.
  • The Qwen3-235B model, which has been fine-tuned using internal expert knowledge, achieves nearly 85 percent accuracy in tests and is 14 times cheaper to operate.
  • This demonstrates that companies can develop powerful AI solutions using their own data without having to share sensitive information with large providers.

Hedge fund Bridgewater and Thinking Machines Lab say a fine-tuned open-weight model outperforms the strongest AI models at evaluating financial documents, at a fraction of the cost. The numbers come from their own internal evaluation.

Investors get buried in news, analysis, corporate filings, and emails every day. According to a report from Bridgewater's AIA Labs and Thinking Machines Lab, the startup founded by former OpenAI CTO Mira Murati, reading isn't the real work. The real work is the constant stream of small, repeated judgment calls about what actually matters. That's the triage the researchers wanted to automate.

They defined six tasks drawn from an investor's daily routine. One example: deciding whether a financial article is relevant to an executive. Another: whether a central bank document signals the direction of future rate changes. For investors, these calls are trivial, but they can barely put their reasoning into words. The report gives a telling example. A headline about Trump's claim to Greenland gets flagged as irrelevant, while Trump's threat of new China tariffs is highly relevant. Both touch on geopolitics and finance.

Frontier models failed in the authors' tests. Variants of Gemini, Claude, and GPT hit only about 50 percent accuracy with a basic prompt. Expert-written instructions and a three-tier rating system ("relevant and interesting," "relevant but uninteresting," "irrelevant") pushed accuracy into the mid-70s. That still fell short of the 80 percent threshold the authors set for trustworthy deployment.

When experts write the prompt, performance jumps sharply compared to a naive prompt. | Image: Thinking Machines

Newer models barely improve per dollar, the report says. GPT 5.4 costs 43 percent more than 5.2 but is only marginally more accurate.

The real value lives inside investors' heads

The solution was fine-tuning, retraining an open-weight model on proprietary examples. The key ingredient was the Bridgewater investors' judgment: At first, cheap outside contractors labeled the documents, but many of those labels were wrong. To avoid having expensive professionals review everything, the researchers used a workaround. A first model learned from the flawed labels and re-evaluated the same documents. Wherever the model and the original label disagreed, there was likely an error. Only those disputed cases went to investors for correction.

Training ran on the Tinker platform from Thinking Machines Lab, built on top of the open model Qwen3-235B. In the team's own evaluation, the fine-tuned model hit 84.7 percent accuracy versus 78.2 percent for the best frontier model tested. It also cost nearly 14 times less to run. This isn't a truly independent comparison, of course. Both companies have a clear interest in selling their product.

Still, the finding beyond the numbers is worth noting. It shows once again that the big labs like OpenAI haven't absorbed all the data out there. Huge pools of proprietary corporate data and untrained human expertise still exist, and they hold real room for improvement. That's especially true where companies deliberately keep their most valuable data private. Anyone who hands that data to a frontier lab risks competing against a product built on top of it.

Fine-tuning open models through tools like Tinker gives companies an alternative. They keep the weights, the data, and, depending on the setup, the GPUs themselves.

来源:The Decoder:AI News(RSS)· the-decoder.com