Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

My small, no name company has lost its mind with AI

teamblind.com

Post reply on HN
Print view View original

91–100 of 101 posts

Re: My small, no name company has lost its mind with AI

#91

Post by polynomial »

jzombie wrote: post #30
intelVISA wrote: post #12

Earlier quoted context omitted.

Once every business can one line invoke an LLM to sufficiently create apps, assuming we reach that stage (possible), isn't that going to kill 90% of VC B2B SaaS especially the YC style round robin of funding each other without generating actual value? Think the CEO's SWEs are the least of his concerns.

Theoretically, if we get to the point where a quality app could actually be generated entirely this way, then someone will inevitably ask it to create an app that recursively asks it to create more apps, thus eliminating the need for anyone to even ask it to create an app at all.

Where do I sign up!

Re: My small, no name company has lost its mind with AI

#92

Post by janalsncm »

Volundr wrote: post #86
janalsncm wrote: post #81

Earlier quoted context omitted.

You don’t update models to add new information. That’s extremely inefficient and susceptible to catastrophic forgetting. If you want the model to have new information you update an offline knowledge base. So yes you can simply not update the model.

Huh? You won't update the model you'll just give it new information? The exact concern is that the new information will be garbage aimed at pushing the model to produce certain output. Much like SEO spammers do to manipulate Google search results. "Just don't update the model, only feed it new information" is exactly how to get to the outcome of concern in this thread.

Yes, updating the model is different from updating the knowledge base the model uses.

Re: My small, no name company has lost its mind with AI

#93

Post by Volundr »

janalsncm wrote: post #92
Volundr wrote: post #86

Earlier quoted context omitted.

Huh? You won't update the model you'll just give it new information? The exact concern is that the new information will be garbage aimed at pushing the model to produce certain output. Much like SEO spammers do to manipulate Google search results. "Just don't update the model, only feed it new information" is exactly how to get to the outcome of concern in this thread.

Yes, updating the model is different from updating the knowledge base the model uses.

Great, so you've updated your knowledge base, it's got garbage targeted to make it attractive to the model, and now your model is outputting garbage. It's the exact same problem Google has fighting the SEO spammers. Now the model is significantly less useful, exactly as suggested.

We've already seen exactly this happened with search. There's no reason to believe that LLMs are immune.

Re: My small, no name company has lost its mind with AI

#94

Post by mcphage »

spaceman_2020 wrote: post #28
riku_iki wrote: post #14

Earlier quoted context omitted.

to me potential killer app is the search, you already now can find better answers fast in many verticals asking chatgpt than going through the tons of seo spam at google.

Health and medical queries are a big one for me. The top results in Google are the same cookie cutter responses from the same 5-10 domains. There is no expertise there - just an article ghost written by a freelance writer with a random doctor’s name attached to it. With the right prompt, chatGPT gives me far better insight and can even point out academic papers to back its claims.

> can even point out academic papers to back its claims

Please, please tell me you at least read these academic papers to make sure they claim what ChatGPT said they're claiming?

Re: My small, no name company has lost its mind with AI

#95

Post by ben_w »

mrguyorama wrote: post #84
friend_and_foe wrote: post #61

Earlier quoted context omitted.

You're missing the point. If we want to know something, we won't even have to google it; we will just ask an LLM . There will be no market for websites full of it because we can just directly ask it to answer our questions. The only "if" to all this is if we will destroy the LLMs by feeding them their own diarrhea. I expect a sort of natural selection here to play out, especially in the open source space. Ones that a…

But there's still no way to get an LLM to only output "fact", because that's not a property of language.

That's also true of a web search engine; but an LLM can (in principle, not saying it's there yet) be able to spot inconsistencies in the source data, to notice disagreement.

Re: My small, no name company has lost its mind with AI

#96

Post by ben_w »

jmye wrote: post #88
spaceman_2020 wrote: post #28

Earlier quoted context omitted.

Health and medical queries are a big one for me. The top results in Google are the same cookie cutter responses from the same 5-10 domains. There is no expertise there - just an article ghost written by a freelance writer with a random doctor’s name attached to it. With the right prompt, chatGPT gives me far better insight and can even point out academic papers to back its claims.

There are no health issues that anyone should ever be using Chat GPT for - the hallucinations are very real, and often severe. Not that you should be googling your symptoms either - there’s a reason we put medical folks through more than a few minutes of training. LLMs are absolutely worthless for medical information.

I wouldn't trust them with my life, but out of curiosity I did put some of my own medical notes into 3.5 a few weeks back.

It said basically the same thing as the actual doctor.

Re: My small, no name company has lost its mind with AI

#97

Post by rajnathani »

threeseed wrote: post #21
Fatboyrunning wrote: post #3

The absence of real applications incorporating this stuff is damning. Where are the killer apps?

Adobe Photoshop, Canva, Final Cut Pro, Notion, Microsoft Office etc. AI is popping up all over the place if you actually pay attention to the products.

Adobe’s Firefly AI and other Adobe AI is the result of billions of dollars of investment over multiple years. Lousy source (sorry): See the number of Adobe authored 2 minute papers (YouTube channel) about AI based graphics over the years.

The rest of the examples shared are mostly just direct integrations with the GPT-4 API, which should be trivial for almost any startup to do. I.e. it’s very likely not going to be game-changing for a CRUD company like OP’s case.

Re: My small, no name company has lost its mind with AI

#98

Post by Planktonne »

spaceman_2020 wrote: post #25

I don’t know what to make of stuff like this. On the one hand, AI in its present form is a great learning tool, and little else. So you’d call the CEO a fool. On the other hand, you have the leading AI firm publicly devoting 1/5th of its resources on controlling AI and declaring that we will likely have Superintelligence within this decade. If the latter is right, this CEO might be a genius who was early on a trend,…

> On the other hand, you have the leading AI firm publicly devoting 1/5th of its resources on controlling AI and declaring that we will likely have Superintelligence within this decade.

This is just marketing.

Re: My small, no name company has lost its mind with AI

#99

Post by riku_iki »

jmye wrote: post #88
spaceman_2020 wrote: post #28

Earlier quoted context omitted.

Health and medical queries are a big one for me. The top results in Google are the same cookie cutter responses from the same 5-10 domains. There is no expertise there - just an article ghost written by a freelance writer with a random doctor’s name attached to it. With the right prompt, chatGPT gives me far better insight and can even point out academic papers to back its claims.

There are no health issues that anyone should ever be using Chat GPT for - the hallucinations are very real, and often severe. Not that you should be googling your symptoms either - there’s a reason we put medical folks through more than a few minutes of training. LLMs are absolutely worthless for medical information.

> LLMs are absolutely worthless for medical information.

chatgpt gives you initial hint/direction, and then you can research specifics by finding actual information in search engine and see if it is hallucinated or not.

Re: My small, no name company has lost its mind with AI

#100

Post by 1123581321 »

bombcar wrote: post #90
1123581321 wrote: post #52

Earlier quoted context omitted.

It was really was a disaster for whip companies, carriage companies and saddle makers, though, disruption didn’t proliferate as quickly then as it does today. You can read some of the history of buggy whip makers. They were specialized manufacturers with established brands built around quality, special materials and style. Some were able to convert to new products but not all. They did survive a couple decades past t…

The key was it took decades - it was a slow moving disaster for them, not a sudden overnight Wonka style shutting of the factories.

It only took a handful of years once cars greatly proliferated in the 20s. Any adoption took longer then to proliferate than it does today, so I would be careful extrapolating from either the pace of adoption in the 20s or the pace of adoption from the invention of the automobile to the beginning of accelerated adoption. You've probably seen this famous graph. https://hbr.org/resources/images/article_assets/2013/11/FELT...
Post reply on HN