Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: How does ChatGPT work?

news.ycombinator.com

Post reply on HN
Print view View original

141–150 of 185 posts

Re: Ask HN: How does ChatGPT work?

#141

Post by djmips »

dzink wrote: post #31
akelly wrote: post #18

The way they went from GPT-3 to ChatGPT is really quite genius. My understanding is that it's something like this: 1. Start with GPT-3, which predicts the next word in some text and is trained on all the text on the internet 2. Take thousands of prompts, generate several responses for each of them, and have human reviewers rank the responses for each prompt from best to worst 3. The GPT model needs a massive amount o…

ChatGPT seems to be/result in some amount of caching of responses - there is very little variation when to asking the same question multiple times. CharacterAI produces a lot more variety in comparison, making it more helpful for brainstorming. That said ChatGPT is likely closer to the truth, even if not perfect, for searches. The innovation happening lately is incredible.

Did you try to vary your question or add modifiers or elaborate?

Re: Ask HN: How does ChatGPT work?

#142

Post by KaoruAoiShiho »

DeWilde wrote: post #112
anthropodie wrote: post #23

Earlier quoted context omitted.

I want to know if it will ever be possible to run this kind of AI at home once its training is complete. I dont need all the knowledge just subset that I'm interested in. Actually I'm more interested in its ability to transform things. For example I can ask it to convert docker-compose to docker run command, it can manipulate JSON, it can sort numbers in table when prompted. I'm more interested in these abilities rat…

It uses GPT-3 under the hood which requires about 350 gigabytes of GPU VRAM (back of the envelope calc, likely more) to perform these inferences.

If this was open sourced it may be quickly optimized, the amount of VRAM required for image generation went down very quickly, I'm sure Dalle-2 is still using enormous vrams but other solutions are not.

Re: Ask HN: How does ChatGPT work?

#143

Post by KaoruAoiShiho »

bozhark wrote: post #125
DeWilde wrote: post #112

Earlier quoted context omitted.

It uses GPT-3 under the hood which requires about 350 gigabytes of GPU VRAM (back of the envelope calc, likely more) to perform these inferences.

7x NVIDIA RTX A6000's so ~$32,550

This is honestly affordable for a lot of upper-middle class people and might well it worth it. It's like the cost of a car. I can seriously see this writing a book for me if I can get it tuned to study only my writing style and remember all of my texts. But it could also only cost $14000 14x RTX 3090s.

Re: Ask HN: How does ChatGPT work?

#144

Post by heartbreak »

KaoruAoiShiho wrote: post #143
bozhark wrote: post #125

Earlier quoted context omitted.

7x NVIDIA RTX A6000's so ~$32,550

This is honestly affordable for a lot of upper-middle class people and might well it worth it. It's like the cost of a car. I can seriously see this writing a book for me if I can get it tuned to study only my writing style and remember all of my texts. But it could also only cost $14000 14x RTX 3090s.

I’ll wait a year and buy $2k worth of hardware that runs it.

Re: Ask HN: How does ChatGPT work?

#145

Post by dotancohen »

Sharlin wrote: post #119
dotancohen wrote: post #109

Earlier quoted context omitted.

The question goes back decades - back then the question was phrased "Can computers think" and the rebuttal was "Can submarines swim?"

On the other hand, airplanes do fly . But I guess that just reinforces the point that language is a map, not the territory, and natural language in particular is full of inconsistencies and fuzzy boundaries between poorly defined categories. English happened to evolve so that it ended up using the same word for the thing both winged creatures and airplanes do, but only living creatures swim , boats and ships and subm…

  > On the other hand, airplanes do fly.
In my language, the verb that airplanes do is different than the verb that birds and insects do. As like the submarine, it is based on a different physical mechanism than are the natural animals in that space.

For that matter, in English, what is the verb that submarines do? Surely it's not "sail".

Re: Ask HN: How does ChatGPT work?

#146

Post by hcks »

ofrzeta wrote: post #35
akelly wrote: post #18

The way they went from GPT-3 to ChatGPT is really quite genius. My understanding is that it's something like this: 1. Start with GPT-3, which predicts the next word in some text and is trained on all the text on the internet 2. Take thousands of prompts, generate several responses for each of them, and have human reviewers rank the responses for each prompt from best to worst 3. The GPT model needs a massive amount o…

> Take thousands of prompts, generate several responses for each of them, and have human reviewers rank the responses for each prompt from best to worst Recently I saw an image where Indian women sat in front of computers and the caption said they were classifying "AI" responses. I guess that's true and this kind of work is the new outsourced cheap labour in the AI age.

I personally worked as a « human trainer » for the fine tuning of ChatGPT.

The pay was 50$ per hour, which is not bad for a side job as a student.

Re: Ask HN: How does ChatGPT work?

#147

Post by dtagames »

stevenhuang wrote: post #55
dtagames wrote: post #3

ChatGPT is really very simple. Imagine you could analyze a million books and identify all the words within them -- not the meanings of the words, just the actual letters they contain. Now, when someone asks you about the history of France (or why the sky is blue), you could simply pluck out of your library the most common strings of word that seem to follow the words that were in your question! It's like a kid in the…

> Another great failing of LLM software is that the user being spoken to is generic. The answers are not modeled for you, they're the same models for everyone. But a human teacher does their job by being exactly the opposite of this -- someone who is finely tuned to the needs and understandings of their audience. A good journalist or writer does the same. ChatGPT can do this if you just ask. E.g., explain as if I'm 5…

Alas, I have. You can ask the tool to parrot styles that it has already seen, but it cannot tailor the output to fill-in the gaps nor persuade someone (or a group) who is at a particular level of understanding. In human writing, these are the most common use cases.

The reason that I write in this manner is that I'd like to scrub out the notion that computers or software are magical. It isn't helpful to our line of business -- unless you're pitching VC. Most people don't know how stupidly simple computers really are, and unfortunately that includes many developers and tech folks.

Re: Ask HN: How does ChatGPT work?

#148

Post by dtagames »

weird-eye-issue wrote: post #130
rakejake wrote: post #97

Earlier quoted context omitted.

This is true but does not refute OP's point. There is an entire subreddit for ELI5 that is probably part of its training data. So if you ask for ELI5, that pattern IS part of the training corpus.

It is more complex than that, it isn't just scraping /r/ELI5 lol Ask it a question about JavaScript and tell it to respond as a 1920s gangster and it will happily oblige and do a great job. And just to make sure we are on the same page, JavaScript was not available in the 20s

It is just scraping and reorganizing words while including words from your prompt in the equation. I already mentioned that the style (gangster) and vocabulary (JavaScript) can come from different scanned documents. Cool? Yes. Is it learning, or understanding? No.

Re: Ask HN: How does ChatGPT work?

#149

Post by dtagames »

nullish_signal wrote: post #36
dtagames wrote: post #11

Earlier quoted context omitted.

I wouldn't deign to have ChatGPT write my comments. They're all me! Obviously, an author's audience can include more than one person. But every good piece of human writing is tailored for some audience. That was my point. You've heard the expression, "Know your audience?" ChatGPT cannot.

ChatGPT's "audience" can range from "hate speech for anti-bias training" to "Teenage Mutant Ninja Turtles Deliver Impassioned Speech to The World" I would also like to use the No True Scotsman fallacy, and assert that no Human can ever really "know" or "write for" anybody's perfect preferences.

I wasn't asking for perfect preferences. I was asking for minimal cognizance, which the tool cannot provide. ChatGPT is more like a parrot than tech dreamers like to admit.

Re: Ask HN: How does ChatGPT work?

#150

Post by throwaway290 »

sebzim4500 wrote: post #102
throwaway290 wrote: post #81

Earlier quoted context omitted.

To be clear there is no 'understanding' going on, and the article doesn't use that word either.

There should be a rule on HN that anyone claiming definitively whether or not AIs 'know' or 'understand' something should have to define those words rigorously.

Pretty much...
Post reply on HN