41–50 of 51 posts
Earlier quoted context omitted.
I really had high hopes for the larger Ternary Bonsai and it feels like there is scope to improve, but I get the sense (albeit a naïve, probably not fully informed sense) that improvement can perhaps only come by training directly into ternary.
All you need is Ternary Aware Training and for AI researchers to come up with a backronym for TIT.
Earlier quoted context omitted.
It is, but why? And what's with the bizarre way of phrasing that? Why the bizarre observation that, indeed, nobody asked for it?
> sign-balanced to a hundredth of a point with no constraint asking for it." This isn't their model, this is (probably?) ChatGPT doing a brag / promo deck authorial voice. It routinely uses half a dozen sentence constructions that are relatively uncommon in normal or technical speech. Eccentric. Persuasive. Trying too hard. Restating its point in a promotional way that doesn't sound natural, leading into a sentence w…
Damn, I was hoping this was about an actual neutrino.
There’s a new announcement every other day wrt models. How do y’all keep track of them all same know what’s decent? Good grief! And if it’s decent today, it’s shit in eight months! I tool hop as much as the next dev but this is a bit much.
There's tons of people caught up in the AI gold rush, but the value of real products for real people is out there. Even more so when you exclude the "I slapped AI onto this"
hey guys, founder here. I am working completely solo right now running on grant funding, so things slipped through on the website quality, it is largely written by AI, I'll deslopify the blogs and be much clearer about methodology. Neutrino-1 is a starting point for Fermion, It's a density experiment on how much capability survives per byte. rn working on really fast and efficient TTS and realtime models to which thi…
Do you have an RSS or a way to subscribe to the TTS work you are doing? Your newsletter button is just a mailto link
hey guys, founder here. I am working completely solo right now running on grant funding, so things slipped through on the website quality, it is largely written by AI, I'll deslopify the blogs and be much clearer about methodology. Neutrino-1 is a starting point for Fermion, It's a density experiment on how much capability survives per byte. rn working on really fast and efficient TTS and realtime models to which thi…
Earlier quoted context omitted.
I really had high hopes for the larger Ternary Bonsai and it feels like there is scope to improve, but I get the sense (albeit a naïve, probably not fully informed sense) that improvement can perhaps only come by training directly into ternary.
I’ve actually been really impressed with the 27b model they recently released - amazing performance approaching 40 tok/s on m4 max and I didn’t run into any quality issues in the small set of tasks I tried. Haven’t gone full coding with it yet but suspect it’s better than say a 9b or 12b model.
It also had some issues that might be parsing/chat template stuff, tool calling oddities. I will try it again, I did try it pretty much the day it shipped and it's possible there are more improvements in their llama.cpp fork since.
It would be churlish to be overcritical, mind you — the PrismML ternary stuff is an advance — but it feels like it should be applied at training. I figure we will see that, somewhere, quite soon.
Did you try the BottleCap ThinkingCap Qwen post-train with the reduced thinking overhead?
Earlier quoted context omitted.
I’ve actually been really impressed with the 27b model they recently released - amazing performance approaching 40 tok/s on m4 max and I didn’t run into any quality issues in the small set of tasks I tried. Haven’t gone full coding with it yet but suspect it’s better than say a 9b or 12b model.
I ran into some issues that are more extreme versions of Qwen's thinking loops while reasoning. It is great at the small puzzles I set for it but it did some frankly insane things on a PHP coding task I set it. It also had some issues that might be parsing/chat template stuff, tool calling oddities. I will try it again, I did try it pretty much the day it shipped and it's possible there are more improvements in their…