Earlier quoted context omitted.
His claim was that the title is misleading, not sure how it's relevant to that claim that you use "string models" (full LLMs). The original title before it changed less than an hour ago was: "Jev: New frontier model 40-400x cheaper and 20-200x faster" I'm going to agree that was misleading. And on the second point: >>Also "can't hallucinate" seems wrong? Sure, it can't emit an invalid type, but it can still emit a co…
> Type safety is not factual correctness. I very much agree with this and want to hone in on where do actually disagree. Would you say a linear classifier hallucinates?
Introducing System One Models and Jev
261–270 of 513 posts
Re: Introducing System One Models and Jev
#262Re: Introducing System One Models and Jev
#263Re: Introducing System One Models and Jev
#264Earlier quoted context omitted.
How is this not a frontier model? It's bleeding edge in its own niche. It's not a frontier LLM; however, applicable to many of the things people use LLMs for.
It's nothing like a traditional LLM and so should not be compared to one. It's a heavily constrained, tiny model that can only produce a probability score or a yes/no answer over pre-defined selections. It has no long-context capacity. I mean, imagine comparing this thing to Astra, it's hilarious. They don't even tell you what the max input size is, and they only allow 10 possible answers to choose from for the Choic…
Frontier LLMs are expensive jack of all trades. You can absolutely compare them to purpose-built tools on any domain they touch. Engineering is all about assessing tradeoffs.
Re: Introducing System One Models and Jev
#265Re: Introducing System One Models and Jev
#266Re: Introducing System One Models and Jev
#267Re: Introducing System One Models and Jev
#268Seems really cool.
Re: Introducing System One Models and Jev
#269https://x.com/completeskeptic/status/2099925682726002904?s=4... The doom demo is quite cool
Instrument your game to output properties of entities near the player and the output is the various control inputs - moment to moment gameplay gets solved. Maybe augment with a tick-by-tick controlled stepping mode if particularly twitchy - an LLM can take care of the higher level reasoning then.
Re: Introducing System One Models and Jev
#270> Outputs > LLMS > Strings / generated text. Strings are flexible and can be anything: chat responses, code, hallucinations, refusals, or even type-safe structured values. To be used by software, responses need to be parsed + validated. There is also always some risk that the AI goes off the rails. > Jev > Type-safe structured values. Possible outputs and structure are defined in advance. The model never makes type e…
What a sad world would you live in if you don't keep creativity for the humans.