Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4o's Memory Breakthrough – Needle in a Needlestack

nian.llmonpy.ai

Post reply on HN
Print view View original

231–240 of 256 posts

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#231

Post by olddustytrail »

moralestapia wrote: post #207
CWuestefeld wrote: post #181

Earlier quoted context omitted.

I hear these complaints and can't see how this is worse than the pre-AI situation. How is an AI "hallucination" different from human-generated works that are just plain wrong, or otherwise misleading? Humans make mistakes all the time. Teachers certainly did back when I was in school. There's no fundamental qualitative difference here. And I don't even see any evidence that there's any difference in degree, either.

Humans know when they've made a mistake. So there's ways to deal with that. Computers are final. You don't want things to be final when your life's on the line.

> Humans know when they've made a mistake.

You'll never make senior management with that attitude. At worst, "mistakes were made" and look a bit sad.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#232

Post by mike_hearn »

antihero wrote: post #146
mike_hearn wrote: post #133

Earlier quoted context omitted.

Note that the IDF explicitly denied that story: https://www.idf.il/en/mini-sites/hamas-israel-war-24/all-art... Probably this is due to confusion over what the term "AI" means. If you do some queries on a database, and call yourself a "data scientist", and other people who call themselves data scientists do some AI, does that mean you're doing AI? For left wing journalists who want to undermine the Israelis (the stor…

The IDF explicitly deny a lot of things, which turn out to be true.

Yeah, but the Guardian explicitly state a lot of things which turn out to be not true also.

Given that the underlying premise of the story is bizarre (is the IDF really so short of manpower that they can't select their own targets), and given that the sort of people who work at the Guardian openly loathe Israel, it makes more sense that the story is being misreported.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#233

Post by olddustytrail »

causality0 wrote: post #205
hackerlight wrote: post #101

Earlier quoted context omitted.

It'll make more sense when they deploy audio and image capability to paying users only, which they say they're going to do in a few weeks

Yeah, but I want a tier where I have access to it in a pinch, but won't feel guilty for spending the money and then going a whole month without using it.

Guilty? Over $20 a month? I spend more than that in an hour down the pub.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#234

Post by runarberg »

mike_hearn wrote: post #232
antihero wrote: post #146

Earlier quoted context omitted.

The IDF explicitly deny a lot of things, which turn out to be true.

Yeah, but the Guardian explicitly state a lot of things which turn out to be not true also. Given that the underlying premise of the story is bizarre (is the IDF really so short of manpower that they can't select their own targets), and given that the sort of people who work at the Guardian openly loathe Israel, it makes more sense that the story is being misreported.

More likely, the IDF is committing a genocide and are finding innovative ways to create a large list of targets which grants them plausible deniability.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#235

Post by seanhunter »

causal wrote: post #95
Aeolun wrote: post #77

Earlier quoted context omitted.

Maybe if you tell it to pull the answer from a limerick instead of generally asking? Edit: Ok no, I tried giving it a whole bunch of hints, and it was just making stuff up that was completely unrelated. Even directly pointing it at the original dataset didn’t help.

Yeah I also tried to get it to complete some limericks from the dataset. Curiously it believed it had heard of the limerick but would then recite a hallucination. So the good news is that the NIAN score might be real, bad news is you can't rely on it to know what it knows.

If you ask it to complete a limerick and it finishes it differently from the original, but it still works as a limerick is that really a hallucination?

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#236

Post by [deleted] »

mike_hearn wrote: post #133
dbspin wrote: post #125

Earlier quoted context omitted.

AI is already being used for picking targets in warzones - https://theconversation.com/israel-accused-of-using-ai-to-ta... . LLM's will of course also be used, due to their convenience and superficial 'intelligence', and because of the layer of deniability creating a technical substrate between soldier and civilian victim provides - as has happened for two decades with drones.

Note that the IDF explicitly denied that story: https://www.idf.il/en/mini-sites/hamas-israel-war-24/all-art... Probably this is due to confusion over what the term "AI" means. If you do some queries on a database, and call yourself a "data scientist", and other people who call themselves data scientists do some AI, does that mean you're doing AI? For left wing journalists who want to undermine the Israelis (the stor…

[deleted]

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#237

Post by racional »

mike_hearn wrote: post #232
antihero wrote: post #146

Earlier quoted context omitted.

The IDF explicitly deny a lot of things, which turn out to be true.

Yeah, but the Guardian explicitly state a lot of things which turn out to be not true also. Given that the underlying premise of the story is bizarre (is the IDF really so short of manpower that they can't select their own targets), and given that the sort of people who work at the Guardian openly loathe Israel, it makes more sense that the story is being misreported.

The underlying premise of the story is bizarre (is the IDF really so short of manpower that they can't select their own targets)

The premise that the IDF would use some form of automated information processing to help select potential targets, in the year 2023?

There's nothing at all unrealistic about this premise, of course. If anything it's rather bizarre to suggest that it might be.

The sort of people who work at the Guardian openly loathe Israel

This sounds you just don't have much to say about the substantive claims of these reports (which began with research by two Israeli publications, +972 and the Local Call -- and then taken further by The Guardian). Or would you say that former two "openly loathe Israel" also? Along with the Israeli sources that they're quoting?

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#238

Post by causality0 »

olddustytrail wrote: post #233
causality0 wrote: post #205

Earlier quoted context omitted.

Yeah, but I want a tier where I have access to it in a pinch, but won't feel guilty for spending the money and then going a whole month without using it.

Guilty? Over $20 a month ? I spend more than that in an hour down the pub.

You get something for your money at the pub. If you pay twenty dollars for a service and then don't use it you have wasted your money.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#239

Post by olddustytrail »

causality0 wrote: post #238
olddustytrail wrote: post #233

Earlier quoted context omitted.

Guilty? Over $20 a month ? I spend more than that in an hour down the pub.

You get something for your money at the pub. If you pay twenty dollars for a service and then don't use it you have wasted your money.

Well, yes, I get more liver damage. I wouldn't worry too much about $20. Give an equal amount extra to charity or bet on something.

There was a time that amount mattered to me but if you're working any kind of dev/ops job it just doesn't any more.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#240

Post by racional »

nopromisessir wrote: post #187
ignoramous wrote: post #180

Earlier quoted context omitted.

> Probably this is due to confusion over what the term "AI" means. AI is how it is marketed to the buyers. Either way, the system isn't a database or simple statistics. https://www.accessnow.org/publication/artificial-genocidal-i... Ex, autonomous weapons like "smart shooter" employed in Hebron and Bethlehem: https://www.hrw.org/news/2023/06/06/palestinian-forum-highli...

[flagged]

[flagged]
Post reply on HN