Ask HN: Predictions for when GPT-5 will be released and how safe it will be? • Hacker News Board

Re: Ask HN: Predictions for when GPT-5 will be released and how safe it will be?

#51

Post by ericlewis » Mon, Jun 10, 2024, 1:53 PM UTC

jankovicsandras wrote: post #10

Here's a completely made up point of view. (I haven't read the articles.) GPT-4 is not an LLM, but a complex software system, which has LLM(s) at its core, but also other components like RAG, toxicity filter, apologizing mechanism, expert systems, etc. "GPT-4" is product name / marketing name. For OpenAI, this would be logical for performance and business reasons. This explains also how they can tune it, the apparent…

ChatGPT is in-fact that. GPT-4 the API is not that. There is clearly no RAG, you bring that yourself, same with toxicity filtering, again - a different api, up to you to implement. etc. There is probably something going on before the input reaches GPT-4 and we are definitely not seeing the raw output from the LLM. But the layers over GPT-4 the API are thinner than ChatGPT.

The Assistants API is closer to ChatGPT & what you are describing.

Edit: it should be noted that the Assistants API is somewhat model agnostic as well, so the product part of this isn't part of the inference system.

Re: Ask HN: Predictions for when GPT-5 will be released and how safe it will be?

#52

Post by Gormo » Mon, Jun 10, 2024, 4:33 PM UTC

HeatrayEnjoyer wrote: post #43

Gormo wrote: post #33

Earlier quoted context omitted.

> If you mean the hallucinations I don't think that will ever really be solved. This is true by definition, since a 'hallucination' isn't a failure condition in which the system isn't working as designed, it's just a post-hoc term for when probabilistic output doesn't meet our expectations, which is inherent to the nature of all probabilistic systems. Within the system, there is no distinction between 'hallucination'…

>have no awareness of the semantic meaning of the tokens they correlate This seems impossible to me. Many of the tasks I use GPT for inherently require understanding and thinking.

And that understanding and thinking is coming from you. GPT is just generating text based on statistical correlations between tokens.

Re: Ask HN: Predictions for when GPT-5 will be released and how safe it will be?

#53

Post by Gormo » Mon, Jun 10, 2024, 4:38 PM UTC

HeatrayEnjoyer wrote: post #49

decide1000 wrote: post #45

Earlier quoted context omitted.

It is kinda hard to grasp but an llm does not 'think'. It basically predicts the next letter in a sentence and it's quite efficient at it.

That's not really a satisfying answer. I could say human brains don't really think, they're just transmitting electrical signals in a saline suspension. Technically true, but it ignores the larger emergent behavior.

It may not be a satisfying answer, but it is a correct one.

The comparison to the underpinnings of human cognition are not really valid, because regardless of the underlying substrate, human beings are indeed building mental models of reality itself via sensory input, so even if human minds and LLMs operated on the exact same process of inference (which we cannot state with confidence is true), then human minds would be generating inferences based on correlations of actual empirical experience, whereas LLMs are only building correlations between words, regardless of what empirical reality those words may or may not correspond to.

So all else being equal, human minds are modeling reality, while LLMs are modeling another model.