Live data from Hacker News

Introducing System One Models and Jev

typesafe.ai

491–500 of 513 posts

Re: Introducing System One Models and Jev

#491
It doesn't produce text -> it does not hallucinate statements

This is kind of trivially satisfied and they make this sound more extraordinary than it is. Also I suppose it can still hallucinate in the sense that for out-of-distribution data it will give miscalibrated probabilities.

Anyway a great step in the direction of calibrated AGI

Re: Introducing System One Models and Jev

#492
post #481

Spent a lot of time - but this makes zero sense to me. It can, maybe, return type safe outputs faster than larger llms - but there is little reason to believe that it will be more accurate. It does absolutely hallucinate - and seems to me that the claim is largely misleading. You architect your systems with typesafe - because it is marginally faster, but inaccurate - to do what ? You can just wait for the next versio…

It isn't marginally faster, it seems to be approx 100x faster and 10-100x cheaper.

Re: Introducing System One Models and Jev

#493

Wasn't really till seeing this home assistant demo they have ( https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 ) that the value really clicked for me. Seems really cool.

This is very cool. However I don’t really want to bounce all my home automation commands to the cloud. I hope there will be an open weights approach one day. I’ve spent a lot of time setting up my local only home automation system, it would suck if it didn’t work during an internet outage, and also there are obvious privacy problems.

How many connected devices do you have? How often do you add/remove some?

I feel like this whole scenario could be solved by a very ugly switch case generated by deepseek for 0.02ct.

Re: Introducing System One Models and Jev

#494
A little off-topic, I have to admit, I did play Doom back in the 90s and I know it is just a game.

But is it just me or other folks feel uncanny seeing "a machine" playing Doom with low-latency as the first demo.

While I'm optimistic that humanity is good (but sometimes makes bad decisions), My first thought was seeing such models used by armies.

Re: Introducing System One Models and Jev

#495
Interesting. Perhaps I can see this being quickly adopted in LLMs-as-a-judge, where you normally need (a) a structured answer, say, with lots of different fields (metrics) and (b) you want the judge to be fast, not being a bottleneck.

Re: Introducing System One Models and Jev

#496

Earlier quoted context omitted.

The inputs aren't natural language. https://docs.typesafe.ai/primitives

The inputs are natural language, they're just also structured into a tree. The first example on that very page shows natural language instructions: questions = { "refund_requested": Noul( instructions="Does the customer request a refund?", ), }

The hybrid nature of this thing is not a detriment, nor does it make it an LLM.

Re: Introducing System One Models and Jev

#497

First, congrats to the team on launching something genuinely interesting and new. Seems like a more accurate title would be "Jev: Trading general purpose generation for fast typed inference" or something like that. This is interesting, but the speed comparison seems misleading? A generative model that can output code in a Turing-complete language can do anything a computer can do. Jev can only generate structured out…

I don’t think it’s misleading if you compare on the use cases they suggested. It’s faster and cheaper (no idea if higher quality), so it’s immediately interesting for certain things. And if you buy their RLCD claims, this might be even better than huge models that know a bunch of irrelevant things.

A calculator is faster and cheaper and higher quality for the use cases I bind my task space to.

It's therefore misleading because they make people believe they're as general purpose as LLMs.

Re: Introducing System One Models and Jev

#498
I wonder how many choices you can give this thing in multiple choice response mode. I'm guessing you could give it enough choices to produce Turing complete programs one symbol at a time when running in a loop, or to hold a conversation when given a vocabulary as the choices. It would be particularly hilarious to just let it choose the next ASCII character of output in a loop.

My guess is that due to its design there is no support for prompt caching, as there would normally be no reason for it. So the performance of my idea would probably be appalling as every step in the loop would reevaluate every input and output token. But it would be interesting to see the outcome.

Re: Introducing System One Models and Jev

#499

I wonder how many choices you can give this thing in multiple choice response mode. I'm guessing you could give it enough choices to produce Turing complete programs one symbol at a time when running in a loop, or to hold a conversation when given a vocabulary as the choices. It would be particularly hilarious to just let it choose the next ASCII character of output in a loop. My guess is that due to its design there…

It likely isn't trained on that task so performance would be worse than frontier models specifically trained for coding.

Re: Introducing System One Models and Jev

#500
post #100

Earlier quoted context omitted.

When they say "can't hallucinate" they mean they produce a confidence value for every result, so you could see for example it has 0.1 confidence, and you can disregard the result - that'd be different from hallucinating where it believes it's correct

that's right, but because these models are probabilistic, it's also possible to be confidently wrong (and all future models will be smarter still and still have that possibility)

Correct. Not to say we're getting into the weeds of probability here as well.

"What are the odds a thunder will strike in Paris at 1pm UTC of 2026-09-16" - that could be a 0.001 chance going from blind historical measurements; 0.01 if it's raining; or 1 or 1 after the date has passed.

Post reply on HN