Live data from Hacker News

The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

thesequence.substack.com

501–510 of 527 posts

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#501

Earlier quoted context omitted.

Let go , make the context further with words , yourself -society- Write books 1000 pages. Force child to read - lucky ones-, make things harder for everyone.

But you are out of context. A box was created that outputs statements: either it has a «concept space» or just works through constructing plausible language. The poster claims leaning towards the "«concept space»" possibility - but this should not be a poll, and indications of "why" (such idea) are needed not to make the claim intellectually sterile. It is important otherwise the users of the box may cling to an illu…

I feel where you want to point me, prev. disc.ns Lets say terms, a dict. And meaning. And pick a cult, say, bjokins, a tribe with 100-500 people, from future, say 7000, year 7866 and say a term, "nunu dumdum" => love and move furter, nunu dumdum as term, should be changed or altered, and lets put nuu dumdum in context of our projection and start to define it, and check perception, you need a community first - tribe- then you need facts to describe this term: lets use it in a sentence, nunu dumdum, ikta pqio => love, life we made a sentence, barely and a new term lets define in context to people in tribe the point is , where would we go ikta pqio ousudum, nunu dumdum=> life must desired, and loved canwe see where r we..

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#502

Earlier quoted context omitted.

Let go , make the context further with words , yourself -society- Write books 1000 pages. Force child to read - lucky ones-, make things harder for everyone.

But you are out of context. A box was created that outputs statements: either it has a «concept space» or just works through constructing plausible language. The poster claims leaning towards the "«concept space»" possibility - but this should not be a poll, and indications of "why" (such idea) are needed not to make the claim intellectually sterile. It is important otherwise the users of the box may cling to an illu…

"by indigence and unaware butchers" The way of speaking here is, with the chosen words and ornament, the author's place in his own personal and whimsical world, the simple context in which it occurs - iron - water - And the summary may be incomprehensible. Which, in the beginning, in a forest, flowers, smelling them - think of it as phrasing a paragraph in one sentence - At this point, the author, without being aware of the words he uses and the way he thinks, actually reflects a personality to the society within his own illusion. This is a disaster for a true writer. The author is actually pulling himself and his surroundings into a whirlpool, with the mistake of supporting the flow of his thoughts, the elite stance he is trying to gain in the society with the ornaments of the words and sentences he has formed. Yes, no matter how pointless it is to continue this, At these points, we can't call it abstraction, it's a fancy salad. Eating, assimilating and digesting this food can be a real waste of time. Because the awareness in the word children and flowers is perhaps a reflection of the awareness in his intellectual journey in his own old and tired world. Yes, it can be a community, a desire to create a caste-like class and take office if necessary. Or not understanding an authority.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#503
post #447

Earlier quoted context omitted.

And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.

What worthwhile insights can arise from someone who can't imagine a hypothetical?

That’s exactly the elitist mindset I’m talking about.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#504
post #447

Earlier quoted context omitted.

…and their votes count just as much as yours.

And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.

I'm not sure what connection there is between IQ and workplace.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#505

Earlier quoted context omitted.

The difference between 3.5 and 4 is gigantic even in my fairly limited experience. I gave them both some common sense tests and this one stuck out to me. Q: A glass door has ‘push’ written on it in mirror writing. Should you push or pull it GPT-3.5: If the word "push" is written in mirror writing on a glass door, you should push the door to open it GPT-4: Since the word "push" is written in mirror writing, it suggest…

GPT-4 fails if we add one more level in this logical problem: Q: A man sees PULL written in mirror writing on a glass door. There's a blind man on the other side of the door. What should the man tell the blind man to open the door and why? GPT-4: The man should tell the blind man to "push" the door to open it. Since the word "PULL" is written in mirror writing on the glass door, it suggests that the correct action on…

I just tried your example in GPT-4 and got the correct response:

>The man should tell the blind man to "pull" the door to open it. The reason is that the man sees the word "PULL" in mirror writing, which means it is written backwards. This is a common technique used on glass doors to indicate the correct action to people on the opposite side of the door. Since the blind man cannot see the instruction, the sighted man should verbally communicate the appropriate action, which is to pull the door.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#506
post #503

Earlier quoted context omitted.

What worthwhile insights can arise from someone who can't imagine a hypothetical?

That’s exactly the elitist mindset I’m talking about.

It is, but you are not really answering the question. Just calling a mindset names does not make it wrong.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#507
post #385

Earlier quoted context omitted.

This used to be true with deterministic algorithms but not anymore. LLMs give you a "good enough" approximate answer which will replace humans in many scenarios previously inaccessible to computers.

Yes, but the GP rightly pointed out that comparing AI capabilities to dumb humans is not very useful. After all, you wouldn't hire random people from the street to do your accounting either. As another example, I doubt that a lawyer's office would want to hire someone who cannot correctly answer the glass door puzzle, even if that person's main task was only summarizing texts. To be fair, at the current pace of devel…

The way I see it is there's now an IQ cutoff below which GPT will serve you better than a human for any "white-collar" task, and that cutoff point is rising with every new model.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#508
post #243

Earlier quoted context omitted.

The difference for me with GPT-4 is its ‘understanding’ of the scene and its explanation of WHY you should push or pull. It talks an out a door with people approaching from different directions. It has some idea of what those people would be thinking. That seems different to just ‘mirror writing means do the opposite’.

Maybe, but consider the post above where GPT4 gets confused about the blind man on the other side of the door, while Vicuna-13b seems to figure it out. I accept that GPT4 gave a better answer in this case, but its level of understanding about the scene under different scenarios still seems limited.

There's also a comment where GPT4 was able to answer the question correctly. Seems like there's some kind of statistics in play.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#509

Earlier quoted context omitted.

> Clearly a company with $5-5MM in the bank can’t train a competitive LLM from scratch... Wait, are we sure? I'm going to make the massive mistake of assuming we're compute bound instead of memory bound, and assume we can train at FP16 (which is a bad assumption because, of course, you're doing calculus where the little pieces you're adding up could get rounded to zero at FP16 pretty easily... although mixed precisio…

The main "issue" with this approach, is you can't iterate quickly. If your idea didn't pan out, you may have wasted some serious time on that one attempt. Not trying to knock it, just wanted to point out that there are potential downsides.

You don't have to restart training though. You can tune hyperparameters and fork one of the previous checkpoints.

Re: The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

#510
post #447

Earlier quoted context omitted.

And that’s fine? A 130+ IQ population would be mindnumbingly boring tbh. We, as a society, need all sorts of humans - not everyone can work at FAANG. In fact, I’d go as far as to say that high IQ people aren’t significantly better at societal decision making.

I'm not sure what connection there is between IQ and workplace.

Which workplace do you vote at?
Post reply on HN