The fact this isn't open-source is troublesome. Such large advances shouldn't be locked up away from local hardware.
Honestly all AI research should be open source but that's just a dream
Introducing System One Models and Jev
471–480 of 513 posts
Re: Introducing System One Models and Jev
#472First, congrats to the team on launching something genuinely interesting and new. Seems like a more accurate title would be "Jev: Trading general purpose generation for fast typed inference" or something like that. This is interesting, but the speed comparison seems misleading? A generative model that can output code in a Turing-complete language can do anything a computer can do. Jev can only generate structured out…
> Assuming there's no funny business, the Doom demo is cool. The Doom demo seems very funny business. They're not feeding it video, they're feeding it a text description of what's going on in the game. It's not reading pixel data. I think LLMs would play a lot better with that input too but Jev does seem to have a huge speed advantage; I don't know if the other models could do that in real-time.
Well, the whole point of the demo was showing that transforming from game state to text to action is so quick with Jev that it can play in real time.
So no, the other models cannot play in real time. Hence why this is interesting.
Re: Introducing System One Models and Jev
#473Earlier quoted context omitted.
For many day-to-day computing use cases, Jev seems far better suited than an autoregressive language model, if for no other reason than it is not wasting compute thinking about anything other than how to spit out a decision. Do you have an architectural explainer yet for Jev or are you holding that close to your chest and letting the magic rip for now?
architecture is close to the chest for now, but we have talked about writing a paper I don't want to shill my blog too much, but I will say data is probably far most interesting than architecture: https://www.completeskeptic.com/p/the-bitterest-lesson
Well, I'm stoked to try it out. We have about a billion reasons a day to call a model like this to rid the world of spam and phishing.
Re: Introducing System One Models and Jev
#474Earlier quoted context omitted.
That's clever and all - solid setup, good work. But I still think you either overestimate the average house guest or have particularly savvy/young house guests.
Most people think it's cool but use it once. The regular-ceiling-lights-as-alarm service gets positive feedback. Weird how smarthome companies never market that, seems easy win.
Not sure I totally understand what you mean by light alarms. Do you just flash ceiling lights to notify the user of something?
Re: Introducing System One Models and Jev
#475[deleted]
Re: Introducing System One Models and Jev
#476Wasn't really till seeing this home assistant demo they have ( https://www.loom.com/share/18c4dbcf8db546dfb2d7f2ef018e78e4 ) that the value really clicked for me. Seems really cool.
Its all fun and games till it turns on blender instead of shutting down garage door
Re: Introducing System One Models and Jev
#477Just trying to validate my understanding - so this is a Large natural language classifier, a general purpose or zero shot classifier ?? it can recognize entities, can classify text into some pre-defined classes ? right? or did i miss something amid all the marketing terms such as system one or RLCD or whatever??
Looks like it.
A general AI classifier that can be set up easily and used to classify anything… but with probably lower quality than a purpose built one.
Re: Introducing System One Models and Jev
#478Just trying to validate my understanding - so this is a Large natural language classifier, a general purpose or zero shot classifier ?? it can recognize entities, can classify text into some pre-defined classes ? right? or did i miss something amid all the marketing terms such as system one or RLCD or whatever??
If you are wait listed and eager to try this, I will save you some time. Try this model - https://huggingface.co/MoritzLaurer/deberta-v3-large-zerosho... . They are using something similar under the hood. The comparison to LLMs on their blog post is definitely shady.
Re: Introducing System One Models and Jev
#479Just trying to validate my understanding - so this is a Large natural language classifier, a general purpose or zero shot classifier ?? it can recognize entities, can classify text into some pre-defined classes ? right? or did i miss something amid all the marketing terms such as system one or RLCD or whatever??
If you are wait listed and eager to try this, I will save you some time. Try this model - https://huggingface.co/MoritzLaurer/deberta-v3-large-zerosho... . They are using something similar under the hood. The comparison to LLMs on their blog post is definitely shady.
Example to try on this model:
customer complaint - My credit card was charged twice for the same subscription
labels - billing, technical, sales
The model will always return something from the above classes - "so it can't hallucinate".
Re: Introducing System One Models and Jev
#480Is this fundamentally different from other text-based LLMs, or is it the same except with special reinforcement learning a safe guards around generating valid types?
Surely it’s still generating some kind unstructured data internally? For example, what if I told it to generate a short story, but the short story is output as a JSON string?