Live data from Hacker News

AI demand is already shrinking

honest-broker.com

81–90 of 116 posts

Re: AI demand is already shrinking

#81
post #20

Strikes me as way, way premature to be making such strident conclusions at this stage. We have barely even got to the point where orgs can run these models in-house on their own data, which is where the strongest perceived benefits have been proposed. I’m something of a skeptic myself. I’m not convinced LLMs are as disruptive as the hype says. But they’re not nothing , and it’s still early.

> I’m something of a skeptic myself. I’m not convinced LLMs are as disruptive as the hype says. But they’re not nothing, and it’s still early.

As someone studying AI and ML: they never were, this was pure hype cycle mania to juice the numbers, be it from existing incumbents trying to prop their stock prices (FB/META) after the massive losses they took from meta-verse, to Open AI teaming up with M$ in a deal that honestly probably let them have a longer life than they would have otherwise as these numbers confirm.

LLM's were the panacea that was going to help the VC world out of a post-COVID slump where massive layoffs, massive losses, down-rounds and overall worker discontent have been the norm since the bubble burst as the cheap money and absurd valuations were destroyed.

This is something that needs to be understood, LLMs are just relying on a form of training (which is really to say surveillance) scraping the internet and is trying to predict the next series of words based on weights on which the algorithm it's operation on deems more successful than the rest--this explains why hallucinations sound so confidently wrong, because someone, somewhere made that same mistake and it was written to sound convincing enough until it was proven otherwise. And nothing more, it cannot reason, it cannot think, it cannot intuit.

I hope this dispels the BS Musk drama about it being the cause for mankind's downfall, when in reality its just statistics; and often made on not very good percentage of accuracy mind you.

This speech by Meredith from Signal [0] underscores what the the real harm AI can pose right now and doesn't rely on some conjecture that somehow goes from a hallucinating LLM to Skynet; the further I go further into my studies (2nd year student) I'm finding out that AI/ML is just as hype-prone as NFT/crypto scams I'm also realizing that maybe cyber-security is far more valuable to what my interests within AI are than I had initially thought and I will likely pivot after this semester.

The last part is so poignant and if people want to face some harsh truths then look no further as it really speaks to what make this all possible.

0: https://www.youtube.com/watch?v=6ROlMFlbkWE

Re: AI demand is already shrinking

#82

The real advantage of LLMs is not search -- that's just something that's easy to show people. No one really wants to talk to an LLM instead of using Google search. The real value is being general reasoning machines. Being able to accomplish basic tasks, retrieve information, etc. is the key value.

Somebody else mentioned the phase of the moon when John Lennon died (which will be ruined in a few days when google indexs this site). There are results for that on the internet, google fails, Kagi fail, but Bings chat pulled the two different sources (one for the day and one for the phases of the moon).

Re: AI demand is already shrinking

#83

It really looks like ChatGPT suffered from some form of "initial over hype syndrome". I'm not underestimating it, actually I think the application of transformers to do what ChatGPT is capable of doing is something really impressive, novel and caught the world by surprise. I'm sure we'll find many equally impressively good applications for it. But people eventually found its limitations. And did it quite fast. People…

People were being told it would replace massive numbers of workers—upper-middle-class knowledge workers, like us—almost instantly. That implies a very high level of cognition and understanding that anyone who interacted with it without a strong preconceived bias in favor of seeing such things would quickly see does not exist.

No, it's not Eliza, but it's also not Skynet, and it was basically being hyped as Skynet. Not by everyone, and not to everyone, but easily enough that when people see that it's way, way less than the strong AI they were promised, they're going to go away disappointed and decide it's not worth their time at all.

Re: AI demand is already shrinking

#84
post #59

Earlier quoted context omitted.

This is my experience. I was initially sceptical, then wowed, then stopped using it entirely when I found out how utterly wrong it was about something it really should have been able to do well. I gave it a programming problem I was having a hard time with, and it came up with the same incorrect answer I had. I explained which part of the answer was wrong, and why. It's response was to apologise, acknowledge that par…

Was this 3.5 or 4? 3.5 kinda sucks for anything tricky.

3.5

I don't feel the question should have been difficult for it. I gave it some Rust code, and asked it how I would access certain elements of a variable. The part that made me think it's useless though, was how it was gaslighting me by apologising, acknowledging, and repeating the same answer. At that point I realised that I would have to be so vigilant when using it, that it would be less effort to figure things out myself.

Re: AI demand is already shrinking

#85

It really looks like ChatGPT suffered from some form of "initial over hype syndrome". I'm not underestimating it, actually I think the application of transformers to do what ChatGPT is capable of doing is something really impressive, novel and caught the world by surprise. I'm sure we'll find many equally impressively good applications for it. But people eventually found its limitations. And did it quite fast. People…

> I asked it "What was the phase of the Moon when John Lennon was killed" What I don't understand is this: when the AI doesn't have >95% confidence it it's answer, why doesn't it just Google like the rest of us? /s

I know this is sarcasm, but is this not similar to what ChatGPT with bing integration was doing?

I had limited exposure before it got removed, but it would actually spell out the searches it would do (often more than one) to answer your question - when it worked it was actually pretty magical.

I never did look into the mechanism for when it decided to search the web, versus just provide you an answer however.

Re: AI demand is already shrinking

#86
post #83

It really looks like ChatGPT suffered from some form of "initial over hype syndrome". I'm not underestimating it, actually I think the application of transformers to do what ChatGPT is capable of doing is something really impressive, novel and caught the world by surprise. I'm sure we'll find many equally impressively good applications for it. But people eventually found its limitations. And did it quite fast. People…

People were being told it would replace massive numbers of workers—upper-middle-class knowledge workers, like us—almost instantly. That implies a very high level of cognition and understanding that anyone who interacted with it without a strong preconceived bias in favor of seeing such things would quickly see does not exist. No, it's not Eliza, but it's also not Skynet, and it was basically being hyped as Skynet. No…

What they sold us was HAL.

What we got was a better MegaHAL.

Re: AI demand is already shrinking

#87
post #48

It's weird to me that some people just don't see the oncoming train. AI is here to stay. Use cases are still being worked out, but it's here to stay. Reminds me of the Astound application around 1995-1996. It was a pretty major PowerPoint competitor and I used it a lot. For whatever reason, they only had a Windows 3.1 version. So I called them asking when the Windows 95 version was coming out. They told me they didn'…

Funny, because AI has seen plenty of applications before ChatGPT, yet "the oncoming train" in most peoples heads is "this is going to completely replace artists, programmers, etc" This is what is laughable, and has been from the very beginning. Will we _continue_ to use AI to try and find novel drug treatments? Yes. Will chatbots still be the first thing a customer support flow uses (and will it still suck)? Yes.

Well said.

Re: AI demand is already shrinking

#88
If only there was some way to predict that the groups working on "AI" are prone to overhyping their work and massively overplaying their hand, causing fatigue, and disinterest in whatever they were selling.

I wonder if the people who worked on "AI" the last three or four times this exact scenario played out could have seen this coming.

Never ever ever trust these "researchers", there's something in the water in that entire field of study that utterly prevents them from approaching their work in a levelheaded and honest manner.

Re: AI demand is already shrinking

#89

Earlier quoted context omitted.

It’s suffering from extreme overhype pushed by OpenAI. They wanted people to think the human-led world was over and they were first to market on creating the new overlords. This soured them on a lot of tech people and ensured whatever they built could never live up. Still a great product and I use a chatbot everyday for work, but it’s just that a chatbot.

> extreme overhype It's hard to gauge hype except retrospectively. We will know in 4-6 years if it was over hyped.

I knew it was overhyped the minute it was all over social media for a couple of months and people started asking what I thought about it.

Re: AI demand is already shrinking

#90
post #79
post #59

Earlier quoted context omitted.

This is my experience. I was initially sceptical, then wowed, then stopped using it entirely when I found out how utterly wrong it was about something it really should have been able to do well. I gave it a programming problem I was having a hard time with, and it came up with the same incorrect answer I had. I explained which part of the answer was wrong, and why. It's response was to apologise, acknowledge that par…

> I was initially sceptical, then wowed, then stopped using it entirely... Similar as well in my case. I think that my problem is that the core of its answers are extremely confident, and it's personally hard for me to switch into the "doubt"-mode when I read such a confident reply. I still use it, but very very rarely, and only when I'm desperate to get at least some hints (and I'm therefore psychologically ready to…

I feel it's really problematic in a bureaucratic environment. AI won't have any compunction about making a false claim. But a bureaucrat has to stick their neck out to say, yeah no that's ridiculous. And also it's easy for AI make an authoritative sounding accusation and then the system to demand the victim be able to prove a negative.
Post reply on HN