Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4 details leaked?

threadreaderapp.com

Post reply on HN
Print view View original

561–570 of 648 posts

Re: GPT-4 details leaked?

#561

Post by schappim »

_ea1k wrote: post #449
schappim wrote: post #97

Earlier quoted context omitted.

Does anyone have a link / instructions on getting Falcon 40b to install on Apple Silicon? Apparently "Hugging Face" have some internal swift code that works (but it has not been released). I'm keen to see how it performs on a maxed out Mac Studio (with all that unified memory available).

I thought this too, but it sounds like the performance of the GPU ultimately holds it back. Maybe it is the software, but I have yet to see a test on Mac silicon that performed well.

It is not too bad, 7B is doing 432 tokens per second on a Macbook[1].

[1] Video: https://huggingface.co/datasets/huggingface/documentation-im...

Re: GPT-4 details leaked?

#562

Post by why_only_15 »

RC_ITR wrote: post #452
why_only_15 wrote: post #205

Earlier quoted context omitted.

Memory does not scale quadratically with sequence length.

During training, you have to store a dot product of Q and V that has dimension Ncrt^2. That's quadratic scaling, no?

presumably you mean a dot product of Q and K, and no you do not have to store this: https://arxiv.org/abs/2205.14135

Re: GPT-4 details leaked?

#563

Post by quickthrower2 »

hospitalJail wrote: post #313
quickthrower2 wrote: post #175

Earlier quoted context omitted.

IMO the real moat right now is expertise / smart teams and cash.

The infrastructure/training libraries already exists. I'm sure you can get people who worked at scale that can figure out how to glue things together. Reddit, twitter, etc.. raising prices is going to make it more expensive.

If you are right then it just becomes who wants to throw the most cash in like a giant game of poker but where you don’t know the pot odds.

Re: GPT-4 details leaked?

#564

Post by kmstout »

londons_explore wrote: post #378
jetrink wrote: post #310

Earlier quoted context omitted.

At a certain point though, models become good enough for particular tasks. Once that happens for whatever my application is, I don't care if OpenAI has a model that's twice as good on some metric, because it's overkill for my use-case. I'm going to be happy using a smaller, cheaper model from a competitor.

I think we're far from that point though. For the vast majority of use cases, I always wish that the answers could be more accurate. Sure - they might be 'good enough' to build a business on. But if a competitor builds their business on top of a more accurate model, their product will work better, and they will win the market.

> their product will work better, and they will win the market

Like Betamax?

Re: GPT-4 details leaked?

#565

Post by 93po »

K0balt wrote: post #194
CamperBob2 wrote: post #67

Earlier quoted context omitted.

At this point, after attempting to start a literal fight with Zuckerberg, Musk is proposing a penis-measuring contest. He appears to be decompensating in real time. If that's salivation fodder, so be it, but it just makes me sad. You hate to see it happen... or at least I do.

Maybe Russia has been injecting lead into his water supply lol. I’m also saddened. Musk is not really a hero or a villain, but his manic stages have given us our first realistic shot at becoming a spacefaring civilization, and moved the needle big time on the lock that the perro cartels had on the automotive industry vis-a-vis electric cars. I hope elon gets better. Losing a billionaire tech maximalists manic episode…

It feels very ignorant to think you can diagnose someone has having manic episodes when you know nothing about them as a person, their motivations, their mental health history, and base all your opinions on mainstream outrage over tweets that are less dumb than most people’s

Re: GPT-4 details leaked?

#566

Post by 93po »

fnordpiglet wrote: post #69
valval wrote: post #62

Earlier quoted context omitted.

If it involves Elon being a bad guy, it is certain to have HNers salivating at the thought.

[flagged]

Can we please stop trying to diagnose mental health issues when we have no background to do so and don’t actually know the patient

Re: GPT-4 details leaked?

#567

Post by JumpCrisscross »

ly3xqhl8g9 wrote: post #536
JumpCrisscross wrote: post #497

Earlier quoted context omitted.

This isn’t a cogent argument. You’re identifying troubling behaviour. But it’s not being stitched into anything cohesive. Hiding bad rhetoric behind post-modernist nihilism is in vogue, but unproductive.

Not sure where you picked nihilism in my reply, referencing the "we live in a society" meme I actually smiled. Nevertheless, stopping the pretence today, painful as it is, realizing the state of the world is far from perfect, is the first step for a better tomorrow.

There is no political debate in which increasing the opposition’s nihilism is not advantageous. Nhilihism keeps people from thinking. It keeps people at home, away from voting booths. There is daylight between Panglossian utopia and dystopia. If you’re cynical, one of the most productive uses of your time might be engaging the other side and convincing them civic engagement is worthless.

Re: GPT-4 details leaked?

#568

Post by K0balt »

93po wrote: post #565
K0balt wrote: post #194

Earlier quoted context omitted.

Maybe Russia has been injecting lead into his water supply lol. I’m also saddened. Musk is not really a hero or a villain, but his manic stages have given us our first realistic shot at becoming a spacefaring civilization, and moved the needle big time on the lock that the perro cartels had on the automotive industry vis-a-vis electric cars. I hope elon gets better. Losing a billionaire tech maximalists manic episode…

It feels very ignorant to think you can diagnose someone has having manic episodes when you know nothing about them as a person, their motivations, their mental health history, and base all your opinions on mainstream outrage over tweets that are less dumb than most people’s

I don’t have a diagnosis obviously, I mean manic as a description of his apparent behavior, not as a pathology. Still, he seems to be not doing great if his social media is to be taken at face value (which is dicey at best) so I do hope that he gets better.

Re: GPT-4 details leaked?

#569

Post by TradingPlaces »

PostOnce wrote: post #558
TradingPlaces wrote: post #336

Earlier quoted context omitted.

Keep in mind, that was the idea originally. Then in 2018 Elon decided he wanted to be CEO, the board rejected that idea for now obvious reasons, and he reneged on 90% of a promised $1b donation. The only way forward was to become a for-profit company and do a normal funding round, which is what happened with Microsoft. Elon’s rug pull is why this happened.

OpenAI was so destitute, having only $100,000,000, that they had no choice but to fuck us all and lobby congress to make it illegal for us to use this new technology? That doesn't make sense. If your choice is between $100M + doing earnest work, or $1B+ and debasing our free and competitive society, and you take the latter... what does that say about your collective character as an organization and as a set of people…

$100m buys you nothing. $1b is table stakes now.

Re: GPT-4 details leaked?

#570

Post by blueprint »

dylan604 wrote: post #494
blueprint wrote: post #460

Earlier quoted context omitted.

semantics, I say. cooks are "chiefs" of certain things otherwise they'd have no value on a team. unless you're saying that chefs setting the menu means theyre more of a scientist. at worst you're saying e.g. scientists are like chefs in that their used their creativity to make up the standard model. at best you're saying chefs are theorists and cooks are experimental scientists which is , again, to my own point.

i'm saying that chefs are more likely to be aware of what is happening when doing the whipping, baking, cooling, etc and why that's important vs just doing it as a step. so when they experiment with the menus, there's a bit more than basic understanding in why they think the experiments might work. cooks are just the kids in chemistry class following the directions, and depending on how well they follow the direction…

says who? cooks at a fine restaurant better know everything about their part. but they chose to try to work under a greater chef because their eventual upward mobility as a practitioner is higher. literally chef means leader or the boss. in the rest of the world that usually means less specifically qualified. not likely here that a chef isnt a good cook but a good cook certainly has the ability to set a menu if they wanted. you're not making a strong argument imo.
Post reply on HN