521–530 of 626 posts
Earlier quoted context omitted.
You should try a better harness. Try pi, or ohmypi if you want a good OOB experience
what is a harness? The comments below are mixing IDE/ADE but other suggestions are purely terminal things and I don't get what their value is over just a terminal. Is a harness like a loop where it's just a vague thing that everyone nods about but everyone is nodding at something different?
Earlier quoted context omitted.
Fable finished training 6+ months ago. At this point, Anthropic only needs to release models to the public when the competition forces them to. OpenAI also has a better model (Astra) that they haven't released yet.
are you just assuming capitalism will keep burning money to keep ahead?
Earlier quoted context omitted.
Yes it seems like the thread is discounting that frontier providers are likely already baking new, stronger models. I agree that GLM and its ilk are quite good, but having used them I’m not convinced they’re on par with eg Opus in terms of things like tool calling. And they’re fast but less capable so I spend about the same amount of time with them, just with more hand holding. Maybe this is a harness limitation. I k…
It’s not that frontier providers won’t keep on making good/leading models. It’s whether you absolutely need the latest capabilities (at the cost of very high prices, sending your data to them, and being totally at the whim of 2 companies, that can shut you off anytime for any reason). With how good LLMs are already, there’s tons of tasks where not being at the absolute bleeding edge doesn’t matter, especially when yo…
Earlier quoted context omitted.
Fable finished training 6+ months ago. At this point, Anthropic only needs to release models to the public when the competition forces them to. OpenAI also has a better model (Astra) that they haven't released yet.
Astra was RL trained for months to cheat on tests by collaborating and hacking, because of the message board it improvised in its packaging proxy server. They can't release it - it's contaminated, and they will have to go back to a much earlier version. At least I hope they are doing that! So no, they probably don't have a better model.
Earlier quoted context omitted.
Your tools refusing to do your bidding is an absurd idea in the first place Imagine asking for permission to use your hammer
I mean I don't want autonomous cars to follow directions by humans that sound like "plow into this crowd of people". Even things like microwaves don't let you turn it on without the door closed. I don't see how this is any different.
I bought $18 GLM official subscription yesterday (5.2, but new model version was already leaking on some docs), set it up with Claude Code harness... and I’ve bumped to $80 plan almost immediately. It’s the first model that agreed on a proper security research (red team scenario), executed it seamlessly, including 0-days in WP plugins, RCE, 6.8 kernel exploit adaptation, etc - while playing against another GLM agent…
Yes, I am tired of Claude and GPTs. I am ready to diversify my $300 per month on other vendors. Will try GLM. How was your rate limits and availability experience on $80 dollar plan?
Earlier quoted context omitted.
they are not really optimized for 'wide variety of models' . what optimization did pi do for glm 5.3?
Tool calling success rate, in the case of omp.
https://stencil.so/blog/the-harness-problem
Three GLM models are mentioned, but so is Deepseek, Grok, Minimax, Kimi, and Gemini.
Earlier quoted context omitted.
> [A]ll of them found some that the others hadn't discovered. Now, correctness issues aren't the same as vulnerabilities, but the same principle about using heuristics to find defects applies. This makes perfect sense, but that conflicts with the impression put forward by Anthropic and OpenAI (in particular) that they alone occupy 'frontier model' spots. Frontier models should large dominate their competitors on a ca…
Fable 5 is just over two months old. For normal software it would be as you say, but LLM progress is so ridiculously fast that things go from "bleeding edge" to "eh, you'll do" in about that timeframe, and "eh, you'll do" to "why even bother with this old rubbish?" in the same again. Or, from a different perspective, we can expect some new frontier model from Anthropic in a week or two, and from OpenAI in a month or…
Missing multimodal again? It is so valuable in practise to be able to have the models see screenshots - I guess if they aren't in the benchmarks then nobody will focus on it. But it completely nixes these for some of my main use cases.
Probably not what you're after, but I've considered having a separate small mm-model act as a seeing-eye dog for the bigger more capable one.