Nice: RedNote just open-sourced dots3-note Preview, a 280b multimodal MoE built for agents that operate over hours.
Its standout idea is TEMPO: a new reinforcement-learning approach that lets an agent critique its own progress, update memory, and learn while navigating long, unfamiliar tasks.
This includes 512K context as well as text, image, video and audio understanding with only 16B of simultaneously active parameters.
Open source keeps on giving