Ox Alpha has now been fully tested against the DeepSWE set by @davis7 . Overall, it's performing more or less on par with GPT-5.6 Sol mid.
But he makes a good point. If it really is GLM-5.3 Flash that's now performing at the level of 5.6 Sol mid and could run locally on a DGX Spark, I wouldn't just be satisfied, it would be an absolutely fantastic deal.
5.6 Sol mid running locally, with the only cost being power consumption, for all sorts of tasks would be incredibly great. This model 24/7 hermes local: game changer.
Actual DeepSWE run on the ox alpha mystery model is done. Ended at ~63% NOT the 80% my first subset test got, which makes way more sense. I've been using this t...