Live data from Hacker News

A new AI winter is coming?

taranis.ie

131–140 of 301 posts

Re: A new AI winter is coming?

#131
post #73

Earlier quoted context omitted.

> Folks say handwavy things like “oh they’ll just sell ads” but even a cursory analysis shows that math doesn’t ad up relative to the sums of money being invested at the moment. We should factor in that messaging that's seamless and undisclosed in conversational LLM output will be a lot more valuable that what we think of as advertising today.

But will also completely poison the well, reducing over-all trust and usage.

I don't see that happening. People have stuck with streaming and social networking as they've trended user-hostile. And with LLMs an even greater type of dependence is being cultivated.

Re: A new AI winter is coming?

#132
post #78
post #57

Earlier quoted context omitted.

I just want to point out a random anecdote. Literally yesterday ChatGPT hallucinated an entire feature of a mod for a video game I am playing including making up a fake console command. It just straight up doesn’t exist, it just seemed like a relatively plausible thing to exist. This is still happening. It never stopped happening. I don’t even see a real slowdown in how often it happens. It sometimes feels like the o…

There is no difference between "hallucination" and "soberness", it's just a database you can't trust. The response to your query might not be what you needed, similar to interacting with an RDBMS and mistyping a table name and getting data from another table or misremembering which tables exist and getting an error. We would not call such faults "hallucinations", and shouldn't when the database is a pile of eldritch…

"Eldritch vectors" is a perfect descriptor, thank you.

Re: A new AI winter is coming?

#133
post #81

Earlier quoted context omitted.

Every time I see comments like these I think about this research from anthropic: https://www.anthropic.com/research/mapping-mind-language-mod... LLMs activate similar neurons for similar concepts not only across languages, but also across input types. I’d like to know if you’d consider that as a good representation of “understanding” and if not, how would you define it?

If i could understand what the brain scans actually meant, I would consider it a good representation. I don't think we know yet what they mean. I saw some headline the other day about a person with "low brain activity" and said person was in complete denial about it, I would be too.

As I said then, and probably echoing what other commenters are saying - what do you mean by understanding when you say computers understand nothing? do humans understand anything? if so, how?

Re: A new AI winter is coming?

#134
post #57
post #49

Earlier quoted context omitted.

> The argument that computational complexity has something to do with this could have merit but the article certainly doesn’t give indication as to why. OP says it is because that predicting the next token can be correct or not, but it always looks plausible because that is what it calculates. Therefore it is dangerous and can not be fixed because it is how it works in essence.

I just want to point out a random anecdote. Literally yesterday ChatGPT hallucinated an entire feature of a mod for a video game I am playing including making up a fake console command. It just straight up doesn’t exist, it just seemed like a relatively plausible thing to exist. This is still happening. It never stopped happening. I don’t even see a real slowdown in how often it happens. It sometimes feels like the o…

> It sometimes feels like the only thing saving LLMs are when they’re forced to tap into a better system like running a search engine query.

This is actually very profound. All free models are only reasonable if they scrape 100 web pages (according to their own output) before answering. Even then they usually have multiple errors in their output.

Re: A new AI winter is coming?

#135
post #31

LLMs are an amazing advancement. The tech side of things is very impressive. Credit where credit is due. Where the current wave all falls apart is on the financials. None of that makes any sense and there’s no obvious path forward. Folks say handwavy things like “oh they’ll just sell ads” but even a cursory analysis shows that math doesn’t ad up relative to the sums of money being invested at the moment. Tech wise I’…

The business trajectory will be like Uber. A few big companies (Google, OpenAI) will price their AI services at a loss until consumers find it to be indispensable and competitors run out of money, then they'll steadily ramp up the pricing to the point where they're gouging consumers (and raking in profits) but still a bit cheaper or better than alternatives (humans in this case).

Re: A new AI winter is coming?

#136
post #21

Earlier quoted context omitted.

> something fundamental has changed that enables a computer to pretty effectively understand natural language. You understand how the tech works right? It's statistics and tokens. The computer understands nothing. Creating "understanding" would be a breakthrough. Edit: I wasn't trying to be a jerk. I sincerely wasn't. I don't "understand" how LLMs "understand" anything. I'd be super pumped to learn that bit. I don't…

Every time I see comments like these I think about this research from anthropic: https://www.anthropic.com/research/mapping-mind-language-mod... LLMs activate similar neurons for similar concepts not only across languages, but also across input types. I’d like to know if you’d consider that as a good representation of “understanding” and if not, how would you define it?

Anthropic is pretty notorious for peddling hype. This is a marketing article - it has not undergone peer-review and should not be mistaken for scientific research.

Re: A new AI winter is coming?

#137

This article uses the computational complexity hammer way too hard, discounts huge progress in every field of AI outside of the hot trend of transformers and LLMs. Nobody is saying the future of AI is autoregressive and this article pretty much ignores any of the research that has been posted here around diffusion based text generation or how it can be combined with autoregressive methods… discounts multi-modal model…

I don't think anybody expects AI development to stop. A winter is defined by a relative drying-up of investment and, importantly, it's almost certain that any winter will eventually be followed by another summer.

The pace of investment in the last 2 years has been so insane that even Altman has claimed that it's a bubble.

Re: A new AI winter is coming?

#138
post #57
post #49

Earlier quoted context omitted.

> The argument that computational complexity has something to do with this could have merit but the article certainly doesn’t give indication as to why. OP says it is because that predicting the next token can be correct or not, but it always looks plausible because that is what it calculates. Therefore it is dangerous and can not be fixed because it is how it works in essence.

I just want to point out a random anecdote. Literally yesterday ChatGPT hallucinated an entire feature of a mod for a video game I am playing including making up a fake console command. It just straight up doesn’t exist, it just seemed like a relatively plausible thing to exist. This is still happening. It never stopped happening. I don’t even see a real slowdown in how often it happens. It sometimes feels like the o…

I like asking it about my great great grandparents (without mentioning they were my great great grandparents just saying their names, jobs, places of birth).

It hallucinates whole lives out of nothing but stereotypes.

Re: A new AI winter is coming?

#139

I'm so annoyed by this negativity. Is AI perfect? No, far from it. Does it have a positive impact on productivity? 100%. Do I care about financials? Absolutely not. There's the regular hype cycle. But these idiotic takes like "dotcom 2.0" and "AI winter" are just and show that the author has no clue what they are talking about.

That 100% claim is doing an awful lot of work. Theres is ample documentation from most corporate rollouts that show the opposite, and as a SWE I find it worse than useless...

Re: A new AI winter is coming?

#140
> This means that they should never be used in medicine, for evaluation in school or college, for law enforcement, for tax assessment, or a myriad of other similar cases.

If AI models can deliver measurably better accuracy than doctors, clearer evaluations than professors and fairer prosecutions than courts, then it should be adopted. Waymo has already shown a measurable decrease in loss of life by eliminating humans from driving.

I believe, technically, moderns LLMs are sufficiently advanced to meaningfully disrupt the aforementioned professions as Waymo has done for taxis. Waymo's success relies on 2 non-llm factors that we've yet to see for other professions. First is exhaustive collection and labelling of in-domain high quality data. Second is the destruction of the pro-human regulatory lobby (thanks to work done by Uber in the Zirp era that came before).

To me, an AI winter isn't a concern, because AI is not the bottleneck. It is regulatory opposition and sourcing human experts who will train their own replacements. Both are significantly harder to get around for high-status white collar work. The great-AI-replacement may still fail, but it won't be because of the limitations of LLMs.

> My advice: unwind as much exposure as possible you might have to a forthcoming AI bubble crash.

Hedging when you have much at stake is always a good idea. Bubble or no bubble.

Post reply on HN