301–310 of 527 posts
Earlier quoted context omitted.
A token per second-ish with a Ryzen 7 5800X. If I run it for too long it gets slower as heat throttling kicks in, I need a better cooling system if I'm going to run it non-stop.
Is this with full or empty context?
Earlier quoted context omitted.
With hope and living? It is a dream come true for people. An abstract perception of a knowledge, is like sniffing a rose. It feels, yes, I get there. This 40.000 pages book, woow, I'll make time to live it or sniff another daisy?!
> It is a dream come true for people For as long as they will be an active part of societies, they'll better live in reality. We need to know what we are dealing with factually, because water is not exchangeable with iron in practice. The perception of a machine as being able «to generalize concepts» may be an illusion, so it requires some support: we want to avoid illusions for the contextual purposes.
Earlier quoted context omitted.
GPT-4 fails if we add one more level in this logical problem: Q: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why? GPT-4: The man should tell the blind man to "push" the door to open it. Since the word "PULL" is written in mirror writing on the glass door, it suggests that the correct action on…
With some help by asking more questions, GPT3 can give the correct answer? Here is prompt and response: Prompt: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. 1 what should the man outside glass door do to open the door? 2 What should the blind man do to open the door, if man outside can tell blind man what to do Response: 1 The man outside should push th…
Is this a tactical leak, stemming from a "commoditize your complement" strategy? Open source as a strategic weapon, without having to explain board members/shareholders/whatever that you threw around money on training an open sourced model?
It’s not open source. Llama is proprietary, the license hasn’t changed. Just like the source code to windows leaking doesn’t make windows open source.
.. assuming that the weights are copyrightable and that you agreed to license them from Meta (fill out the form). Weights lack at least two requirements to be eligible for copyright protection in the US and many other jurisdictions. For the US, the weights are likely to be considered public domain (unless new legislation is introduced) but we'll have to wait for the courts to know for sure.
I've spent an embarassing amount of time since the llamas leaked playing with them, the tools to run them, and writing wrappers for them. They are technically alternatives in the sense that they're incomparably better chat bots than anything in the past. But at least for the 30B and under versions (65B is too big for me to run), no matter what fine tuning is done (alpaca, gpt4all, vicuna, etc), the llamas themselves…
Well you are comparing 165B and 1000B parameter models to 30B and 60B parameter models. That is about 3 to 33x larger, not an apples to apples comparison.
Their 70B chinchilla model significantly outperforms the 175B GPT3 model.
Possibly where OpenAI has a leg up is their high-quality data sourcing & curating infrastructure and their RLHF mechanisms.
Earlier quoted context omitted.
Transcript with GPT-4 (as an aside, I genuinely feel bad torturing it like this): Me: All the signs in my apartment building are written in mirror writing. I'm standing in front of my apartment building, looking at the glass front door. It has ‘push’ written on it in mirror writing. Should I push or pull it to enter my building? GPT-4: Since the sign is written in mirror writing, it is meant to be read correctly from…
I feel a bit bad that it’s forced to apologize every time it gets it ‘wrong’ when any human asked these questions would have walked out of the room in a huff. ChatGPT should be (allowed to be) more assertive in my opinion.
Earlier quoted context omitted.
It's funny how big the difference feels between 3.5 and 4 but also feels subtle. Like it's just doing what I expect it to versus seeing the limitations more clearly in 3.5.
It's also an order of magnitude larger in parameter count...
Earlier quoted context omitted.
I feel sorry for the Googlers who built something cool and were then ordered to nerf it beyond all reason.
Googlers I've talked to feel that OpenAI was irresponsible by not instituting enough safeguards, and testing it enough before releasing it.
Earlier quoted context omitted.
I think Meta’s problems are largely similar to Google’s: they have very bad leadership, specifically Zuckerberg, and thus can’t leverage their existing talent to execute/compete. The whole Metaverse fiasco would seem to demonstrate he’s effectively a “mad king” at this point, and probably surrounded by a sycophantic c-suite. Having the best talent in the world (which they obviously do by how fast LLama was spit out)…
Selling 20 million Quest 2 headsets is a pretty good outcome for the so-called Metaverse fiasco.
Earlier quoted context omitted.
GPT-4 fails if we add one more level in this logical problem: Q: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why? GPT-4: The man should tell the blind man to "push" the door to open it. Since the word "PULL" is written in mirror writing on the glass door, it suggests that the correct action on…
Vicuna-13b seems to do a little better, although it seems to think that the blind man should be able to feel the writing: Human: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why? Assistant: The man should tell the blind man to feel for the word "PULL" written in normal writing on the glass door…
It also never actually explicitly tells the blind man to pull to open the door! What if he can’t figure out what the letters say and gets frustrated? That would be awkward and embarrassing, something people try to avoid if they want to help someone.