Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4o's Memory Breakthrough – Needle in a Needlestack

nian.llmonpy.ai

Post reply on HN
Print view View original

171–180 of 256 posts

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#171

Post by meindnoch »

nvarsj wrote: post #164
sschueller wrote: post #112

We are all so majorly f*d. The general public does not know nor understand this limitation. At the same time OpenAI is selling this a a tutor for your kids. Next it will be used to test those same kids. Who is going to prevent this from being used to pick military targets (EU law has an exemption for military of course) or make surgery decisions?

I’ve had coworkers suggest a technical solution that was straight up fabricated by an LLM and made no sense. More competent people realise this limitation of the models and can use them wisely. Unfortunately I expect to see the former spread.

I've spent a few hours last week crafting a piece of code for my coworker, and then when I asked him to test it in the real environment, it turned out that the API he wanted to connect to the code I gave him was just a hallucination by ChatGPT.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#172

Post by feverzsj »

infecto wrote: post #161
feverzsj wrote: post #141

LLMs are still toys, no one should treat them seriously. Apparently, the bubble is too massive now.

We have businesses getting real value from these toys. Maybe you have not been in the right circles to experience this?

Of course you can get value from toy business, but toys are toys.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#173

Post by ethbr1 »

sschueller wrote: post #112

We are all so majorly f*d. The general public does not know nor understand this limitation. At the same time OpenAI is selling this a a tutor for your kids. Next it will be used to test those same kids. Who is going to prevent this from being used to pick military targets (EU law has an exemption for military of course) or make surgery decisions?

I get a good chuckle every morning when the "C3.ai" ad rolls on NPR.

"Hallucination-free," indeed.

Would love to know what actual, contractual guarantees they place around that.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#174

Post by infecto »

feverzsj wrote: post #172
infecto wrote: post #161

Earlier quoted context omitted.

We have businesses getting real value from these toys. Maybe you have not been in the right circles to experience this?

Of course you can get value from toy business, but toys are toys.

[flagged]

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#175

Post by mrbungie »

throwthrowuknow wrote: post #136
dbspin wrote: post #125

Earlier quoted context omitted.

AI is already being used for picking targets in warzones - https://theconversation.com/israel-accused-of-using-ai-to-ta... . LLM's will of course also be used, due to their convenience and superficial 'intelligence', and because of the layer of deniability creating a technical substrate between soldier and civilian victim provides - as has happened for two decades with drones.

Why? There are many other types of AI or statistical methods that are easier, faster and cheaper to use not to mention better suited and far more accurate. Militaries have been employing statisticians since WWII to pick targets (and for all kinds of other things) this is just current-thing x2 so it’s being used to whip people into a frenzy.

Because you can charge up a lot more when adding hot and hyped features like LLMs instead of doing good engineering.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#176

Post by sumedh »

sftombu wrote: post #73
a_wild_dandan wrote: post #40

Earlier quoted context omitted.

No you don't. Compare the model's performance before and after uploading the material.

Previous answer to this question: https://news.ycombinator.com/item?id=40361419s

No such item.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#179

Post by farmdve »

sschueller wrote: post #112

We are all so majorly f*d. The general public does not know nor understand this limitation. At the same time OpenAI is selling this a a tutor for your kids. Next it will be used to test those same kids. Who is going to prevent this from being used to pick military targets (EU law has an exemption for military of course) or make surgery decisions?

Next it's going to teach them the Earth is flat and there are aliens behind the moon.

Re: GPT-4o's Memory Breakthrough – Needle in a Needlestack

#180

Post by ignoramous »

mike_hearn wrote: post #133
dbspin wrote: post #125

Earlier quoted context omitted.

AI is already being used for picking targets in warzones - https://theconversation.com/israel-accused-of-using-ai-to-ta... . LLM's will of course also be used, due to their convenience and superficial 'intelligence', and because of the layer of deniability creating a technical substrate between soldier and civilian victim provides - as has happened for two decades with drones.

Note that the IDF explicitly denied that story: https://www.idf.il/en/mini-sites/hamas-israel-war-24/all-art... Probably this is due to confusion over what the term "AI" means. If you do some queries on a database, and call yourself a "data scientist", and other people who call themselves data scientists do some AI, does that mean you're doing AI? For left wing journalists who want to undermine the Israelis (the stor…

> Probably this is due to confusion over what the term "AI" means.

AI is how it is marketed to the buyers. Either way, the system isn't a database or simple statistics. https://www.accessnow.org/publication/artificial-genocidal-i...

Ex, autonomous weapons like "smart shooter" employed in Hebron and Bethlehem: https://www.hrw.org/news/2023/06/06/palestinian-forum-highli...

Post reply on HN