Earlier quoted context omitted.
Let go , make the context further with words , yourself -society- Write books 1000 pages. Force child to read - lucky ones-, make things harder for everyone.
But you are out of context. A box was created that outputs statements: either it has a «concept space» or just works through constructing plausible language. The poster claims leaning towards the "«concept space»" possibility - but this should not be a poll, and indications of "why" (such idea) are needed not to make the claim intellectually sterile. It is important otherwise the users of the box may cling to an illu…
The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
501–510 of 527 posts
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#502Earlier quoted context omitted.
Let go , make the context further with words , yourself -society- Write books 1000 pages. Force child to read - lucky ones-, make things harder for everyone.
But you are out of context. A box was created that outputs statements: either it has a «concept space» or just works through constructing plausible language. The poster claims leaning towards the "«concept space»" possibility - but this should not be a poll, and indications of "why" (such idea) are needed not to make the claim intellectually sterile. It is important otherwise the users of the box may cling to an illu…
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#503Earlier quoted context omitted.
And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.
What worthwhile insights can arise from someone who can't imagine a hypothetical?
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#504Earlier quoted context omitted.
…and their votes count just as much as yours.
And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#505Earlier quoted context omitted.
The difference between 3.5 and 4 is gigantic even in my fairly limited experience. I gave them both some common sense tests and this one stuck out to me. Q: A glass door has ‘push’ written on it in mirror writing. Should you push or pull it GPT-3.5: If the word "push" is written in mirror writing on a glass door, you should push the door to open it GPT-4: Since the word "push" is written in mirror writing, it suggest…
GPT-4 fails if we add one more level in this logical problem: Q: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why? GPT-4: The man should tell the blind man to "push" the door to open it. Since the word "PULL" is written in mirror writing on the glass door, it suggests that the correct action on…
>The man should tell the blind man to "pull" the door to open it. The reason is that the man sees the word "PULL" in mirror writing, which means it is written backwards. This is a common technique used on glass doors to indicate the correct action to people on the opposite side of the door. Since the blind man cannot see the instruction, the sighted man should verbally communicate the appropriate action, which is to pull the door.
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#506Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#507Earlier quoted context omitted.
This used to be true with deterministic algorithms but not anymore. LLMs give you a "good enough" approximate answer which will replace humans in many scenarios previously inaccessible to computers.
Yes, but the GP rightly pointed out that comparing AI capabilities to dumb humans is not very useful. After all, you wouldn't hire random people from the street to do your accounting either. As another example, I doubt that a lawyer's office would want to hire someone who cannot correctly answer the glass door puzzle, even if that person's main task was only summarizing texts. To be fair, at the current pace of devel…
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#508Earlier quoted context omitted.
The difference for me with GPT-4 is its ‘understanding’ of the scene and its explanation of WHY you should push or pull. It talks an out a door with people approaching from different directions. It has some idea of what those people would be thinking. That seems different to just ‘mirror writing means do the opposite’.
Maybe, but consider the post above where GPT4 gets confused about the blind man on the other side of the door, while Vicuna-13b seems to figure it out. I accept that GPT4 gave a better answer in this case, but its level of understanding about the scene under different scenarios still seems limited.
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#509Earlier quoted context omitted.
> Clearly a company with $5-5MM in the bank can’t train a competitive LLM from scratch... Wait, are we sure? I'm going to make the massive mistake of assuming we're compute bound instead of memory bound, and assume we can train at FP16 (which is a bad assumption because, of course, you're doing calculus where the little pieces you're adding up could get rounded to zero at FP16 pretty easily... although mixed precisio…
The main "issue" with this approach, is you can't iterate quickly. If your idea didn't pan out, you may have wasted some serious time on that one attempt. Not trying to knock it, just wanted to point out that there are potential downsides.
Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT
#510Earlier quoted context omitted.
And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.
I'm not sure what connection there is between IQ and workplace.