Earlier quoted context omitted.
Guess I'm a bit less impressed seeing that for some of the more intelligent driven+action work -- splitting requests in the video -- they had to kick out to an anthropic model.
Haiku, to rewrite a sentence as two discreet commands. I agree that it was notable that they delegated to an existing LLM, but I don't think it detracts much from the value proposition (not yet proven) of their demo.
Introducing System One Models and Jev
311–320 of 512 posts
Re: Introducing System One Models and Jev
#312Re: Introducing System One Models and Jev
#313Wow, this is really cool. If this holds up to scrutiny, and has a decent context window (+16k), it suddenly changes our project's status from "cool concept, too slow and expensive to release" to "doable", just like that. Just joined the waitlist, excited to try it out!
Re: Introducing System One Models and Jev
#314They never show exactly how they use it? Only a bunch of animations of it 'working'. Would like to see the actual code used for the demos!
It's a bit hastily put together, but I made a dspy fork where you can add a decorator to automatically use TypeSafe where possible on Signatures. It shows a fair bit of what actual, hands on usage looks like. https://github.com/typesafeainate/dspy-typesafeify
Thanks for putting this together. I'm surprised the cost saving is so little though. I expected much more based on the post.
Re: Introducing System One Models and Jev
#315First, congrats to the team on launching something genuinely interesting and new. Seems like a more accurate title would be "Jev: Trading general purpose generation for fast typed inference" or something like that. This is interesting, but the speed comparison seems misleading? A generative model that can output code in a Turing-complete language can do anything a computer can do. Jev can only generate structured out…
When they say "can't hallucinate" they mean they produce a confidence value for every result, so you could see for example it has 0.1 confidence, and you can disregard the result - that'd be different from hallucinating where it believes it's correct
Re: Introducing System One Models and Jev
#316First, congrats to the team on launching something genuinely interesting and new. Seems like a more accurate title would be "Jev: Trading general purpose generation for fast typed inference" or something like that. This is interesting, but the speed comparison seems misleading? A generative model that can output code in a Turing-complete language can do anything a computer can do. Jev can only generate structured out…
I feel like the power of the approach presented here is that it gives a model a proper "language" to describe computations directly vs moving tape silliness. I foresee this to be the path moving forward - giving AI models understanding of the computation directly(as well as compositional rules) This feels like a short path towards total software in many areas.
Re: Introducing System One Models and Jev
#317That would be the litmus test.
"Does not hallucinate" is not the same as "is never wrong".
So the ATC test could be the benchmark.
Re: Introducing System One Models and Jev
#318Earlier quoted context omitted.
Nothing, but imagine using LLMs for a classification task People out there are so resigned to the models being unreliable that they are really doing things like hallucinating deliberately, and then matching the hallucinations to embeddings - https://softwaredoug.com/blog/2026/08/10/hypothetical-classi... You could do that or you could just... use a model that will never produce unreliable outputs in the first place.
But we're going from "Apple" to "Apple: 99% - trust me". It could still be an image of an orange :)
Re: Introducing System One Models and Jev
#319Wasn't really till seeing this home assistant demo they have ( https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 ) that the value really clicked for me. Seems really cool.
Side note - just like most people don't need an intelligent personal assistant to manage and respond their emails and book their flights, most people also don't need smart homes. Century old toggle switches are more than enough in a 3 room apartment or 5 room house unless you have a mention.
Re: Introducing System One Models and Jev
#320Wasn't really till seeing this home assistant demo they have ( https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 ) that the value really clicked for me. Seems really cool.