ANTHROPIC 🔥: Claude may get a new Model Comparison interface for users to have a simple way to see the difference in responses from different models.
Users will be able to turn memory on and off, as well as "hold" responses. Unlike in an A/B testing UI, it looks like users will be able to switch between normal chats and model comparison mode themselves on demand.
Built-in LM Arena 👀