Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

151–160 of 1001 posts

Re: GPT-4

#151

Post by _boffin_ »

101008 wrote: post #130
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

Besides the fact that this comment reads written by GPT itself, using this particular AI as a source for your education is like going to the worse University out there. I am sure if you always wishes do thave a personal PhD in a particular subject you could find shady universities out there who could provide one without much effort. [I may be exagerating but the point still stands because the previous user also didn'…

This comment (this one right here) wasn't written with GPT, but I did have the other one refined by it. I think in elongated thoughts and a lot of continuations, which makes me a bit shy of my writings. Because of that, I use it to help me find different ways to improve my writing.

I live near UCI and yes, I can find one, but at a sizable cost. I'm not opposed to that, but it's still a good chunk of money.

Re: GPT-4

#152

Post by minimaxir »

From a business perspective as someone whose spent a lot of time working with GPT-3/ChatGPT API (https://news.ycombinator.com/item?id=35110998), I'm surprisingly underwhelmed by this announcement. The announcement and examples seems to be focusing more on reasoning capabilities, which are indeed impressive, but I'd need to spend a lot of time experimenting to see how they compare to ChatGPT's API.

The $0.06 per 1k completion tokens for GPT-4 is what I expected OpenAI to set the ChatGPT API, but instead the ChatGPT API is 30x cheaper and honestly its output is not much worse than the GPT-4 demos if at all, and the longer context windows offered by GPT-4 just raise the price considerably.

Re: GPT-4

#153

Post by ml_basics »

What's the lifespan of an LLM going to be in the next few years? Seems like at the current pace, cutting edge models will become obsolete pretty quickly. Since model training is very expensive, this means the LLM space has some parallels with the pharmaceutical industry (massive upfront capital costs, cheap marginal costs relative to value produced).

I find it quite fascinating how quickly machine learning has changed in this regard.

Re: GPT-4

#154

Post by wly_cdgr »

Atreiden wrote: post #37

I think it's interesting that they've benchmarked it against an array of standardized tests. Seems like LLMs would be particularly well suited to this kind of test by virtue of it being simple prompt:response, but I have to say...those results are terrifying. Especially when considering the rate of improvement. bottom 10% to top 10% of LSAT in What are the implications for society when general thinking, reading, and…

Not sure what happens, but I will say that human chess is more popular than ever even though everyone knows that even the best humans are hopelessly terrible compared to the leading engines.

Something else that comes to mind is running. People still find running meaningful and compelling even though we have many technologies, including autonomous ones, that are vastly better at moving us and/or themselves through space quickly.

Also, the vast majority of people are already hopelessly worse than the best at even their one narrow main area of focus. This has long (always?) been the case. Yet people still find meaning and pleasure in being the best they can be even when they know they can never come close to hanging with the best.

I don't think PSYCHOLOGICALLY this will change much for people who are mature enough to understand that success is measured against your potential/limitations and not against others. Practically, of course, it might be a different question, at least in the short term. It's not that clear to me that the concept of a "marketable skill" has a future.

"The Way of the Samurai is found in death...To say that dying without reaching one's aim is to die a dog's death is the frivolous way of sophisticates. When pressed with the choice of life or death, it is not necessary to gain one's aim." - from Hagakure by Yamamoto Tsunetomo, as translated by William Scott Wilson.

Re: GPT-4

#155

Post by GaggiX »

The paper is 98 pages long and I didn't find anything about the actual architecture of the model, the irony.

Re: GPT-4

#156

Post by [deleted] »

ml_basics wrote: post #136

From the paper: > Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar. I'm curious whether they have continued to scale up model size/compute significantly or if they have managed to make significant innovati…

[deleted]

Re: GPT-4

#157

Post by Arisaka1 »

andrepd wrote: post #102
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

But it often produces wrong information. If you don't know the subject (since you are learning), how do you distinguish between correct information and incorrect but very plausible-sounding information?

The same way anyone lacking knowledge can confident say that they got the right information from anyone with experience: You don't. You just trust them. That's what I did with my gastrenterologist, I ended up got misdiagnosed for 4 years and instead of getting the treatment that I should be getting I lost weight, got osteoporosis and vitamin D deficiency.

4 years later the second doctor asked me "I wonder why did my colleague decided not to take a tissue sample from insert some place in the stomach. I said out loud "I didn't even know what that is, let along ask him why he didn't".

Re: GPT-4

#158

Post by [deleted] »

ml_basics wrote: post #136

From the paper: > Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar. I'm curious whether they have continued to scale up model size/compute significantly or if they have managed to make significant innovati…

[deleted]

Re: GPT-4

#159

Post by substation13 »

It's interesting that everyone is talking about programmers being replaced by AI, but the model did far better on the humanities type subjects than on the programming tests.

Re: GPT-4

#160

Post by teawrecks »

101008 wrote: post #130
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

Besides the fact that this comment reads written by GPT itself, using this particular AI as a source for your education is like going to the worse University out there. I am sure if you always wishes do thave a personal PhD in a particular subject you could find shady universities out there who could provide one without much effort. [I may be exagerating but the point still stands because the previous user also didn'…

> like going to the worse University out there.

...without going anywhere.

Wikipedia isn't great compared to a degree from a top university, but it's also readily available and is often a first reference for many of us.

Post reply on HN