So in theory you could feed it incomplete text, and then ask it for the probabilities of what the next character could be?
Introducing System One Models and Jev
41–50 of 512 posts
Re: Introducing System One Models and Jev
#42This sounds good but so far all claims just sound like marketing terms. I'd love to see real proof. e.g. "RLCD" and "parallel sampling" have nothing to back it up. also "70-500ms vs 3-329 seconds" are apples-to-oranges unless the LLM baseline is doing comparable work (e.g., long chain-of-thought). If Jev is skipping generation entirely for a narrow structured task, of course it's faster. Nonetheless i want this to be…
Did you see the video where it plays Doom, it made it click for me
Re: Introducing System One Models and Jev
#43It looks like a specialized encoder-only(-ish) transformer with scalar and ordinal output heads. Acausal in effect, maybe? Probably not even autoregressive?
I'd use this as a tool an LLM can use for specialized tasks. It's not AI in itself.
Re: Introducing System One Models and Jev
#44I would love for things like this to be accessible via hubs like open router or AWS bedrock. It's hard to justify adding new model vendors directly with all the heightened concerns about privacy and security, but if bold new capabilities are added to a centralized already-vendor like AWS, technical people can adopt them without going through a whole compliance/purchasing/vendor review process. And an extra middleman…
Isn't openrouter the exact opposite of caring about security and privacy?
I guess you can choose your provider still? But isn't the point that the lowest bidder is doing inference?
Re: Introducing System One Models and Jev
#45> [others] Output tokens: ~5x more expensive than input tokens. > [them] Output tokens: FREE (too cheap to meter). I'm very confused by this.
They're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap.
Re: Introducing System One Models and Jev
#46So in theory you could feed it incomplete text, and then ask it for the probabilities of what the next character could be?
If you provide it an AST of the english language, yes.
Re: Introducing System One Models and Jev
#47Earlier quoted context omitted.
Direct link to the Doom video tweet: https://x.com/completeskeptic/status/2099925687465570372
The doom video is also in the article itself (headline: "Doom"). I suppose this is the same video as the one from the parent comment, but I don't know for sure - I don't have a twitter account and the above link doesn't work for me.
I linked to the tweet that has the video because if you are not signed in you cannot see the whole thread of tweets.
I can see the individual tweets in the browser while not signed in though.
Re: Introducing System One Models and Jev
#48um what is going on with the outfit changes in the launch video... https://x.com/CompleteSkeptic/status/2099925682726002904
Can't tell if they're just having fun or if it is ai-generated. On the verge of not being able to tell. Voice sounds a little synthetic.
Re: Introducing System One Models and Jev
#49If this is true means, AI Stock bubble burst. (For good)
Re: Introducing System One Models and Jev
#50um what is going on with the outfit changes in the launch video... https://x.com/CompleteSkeptic/status/2099925682726002904
Pretty sure that's an intended joke.
Reminds me of this: https://www.reddit.com/r/ITcrowd/comments/tg05j1/i_cant_beli...