Live data from Hacker News

Google's Bard shows incorrect information in its launch ad

twitter.com

41–50 of 234 posts

Re: Google's Bard shows incorrect information in its launch ad

#41

I think there is a genuine concern that Google could overreact and launch a half-baked product in pure panic of being left behind or one upped by Microsoft. There is also a fear, I think, that the ChatGPT integration with Bing/Edge could not go all that smoothly. I think it could be game changing in many ways, but I can also see both of these falling apart. Amazon Alexa, Google Assistant and Siri were thought to be g…

>I do think there is unique break here though, because I feel that SEO has so thoroughly ruined search in many regards that this -could- be the right moment for this. the problem here is monetization, will search even be profitable if LLMs are used for most queries? It might become a Uber/Lyft or food delivery situation where these companies aren't really able to profitably deliver the service. I don't see many peopl…

> the problem here is monetization, will search even be profitable if LLMs are used for most queries?

I think that is a concern, which is why I think Microsoft has a chance to just bundle this or a more advanced version with Microsoft 365. Then you're already paying for it. That automatically puts it in the hands of millions of paying customers and corporations. You can just raise your price by a dollar a month or something to offset the costs and no one really will even think they are paying for this.

Re: Google's Bard shows incorrect information in its launch ad

#43

I think there is a genuine concern that Google could overreact and launch a half-baked product in pure panic of being left behind or one upped by Microsoft. There is also a fear, I think, that the ChatGPT integration with Bing/Edge could not go all that smoothly. I think it could be game changing in many ways, but I can also see both of these falling apart. Amazon Alexa, Google Assistant and Siri were thought to be g…

Maybe. The way I see it- whoever has the data wins in this new AI arms race. Google would have to make the biggest blunder in history to screw this up. It's not impossible but I wouldn't count them out. Their entire existence and practice of hoovering up all data has led to them this point.

Re: Google's Bard shows incorrect information in its launch ad

#45

I think there is a genuine concern that Google could overreact and launch a half-baked product in pure panic of being left behind or one upped by Microsoft. There is also a fear, I think, that the ChatGPT integration with Bing/Edge could not go all that smoothly. I think it could be game changing in many ways, but I can also see both of these falling apart. Amazon Alexa, Google Assistant and Siri were thought to be g…

> lose these companies money

How can you say Siri loses Apple money? Does GarageBand lose them money? Photo Booth? Contacts?

Re: Google's Bard shows incorrect information in its launch ad

#46
post #40

There was a lot of stories like "Webb captures it's fist ever picture of an exoplanet" [eg]. My guess is that it's digesting those and not understanding that the "it's" in that sentence is critical. Here is a prior example of an exoplanet picture: https://esahubble.org/images/heic0821a/ [eg] https://blogs.nasa.gov/webb/2022/09/01/nasas-webb-takes-its-...

I can't tell from the tweet why the Bard response is wrong. Is it because some other instrument has taken an image of an exoplanet, or because no instrument has ever done so? ChatGPT seems to believe it is the latter.

Another instrument took an image of an exoplanet, in 2005.

https://exoplanets.nasa.gov/resources/300/2m1207b-first-imag...

Re: Google's Bard shows incorrect information in its launch ad

#47

I think there is a genuine concern that Google could overreact and launch a half-baked product in pure panic of being left behind or one upped by Microsoft. There is also a fear, I think, that the ChatGPT integration with Bing/Edge could not go all that smoothly. I think it could be game changing in many ways, but I can also see both of these falling apart. Amazon Alexa, Google Assistant and Siri were thought to be g…

> lose these companies money How can you say Siri loses Apple money? Does GarageBand lose them money? Photo Booth? Contacts?

By that logic Alexa can't lose Amazon any money because it's baked into their products. But in fact, it's a massive money suck. It lost $10B last year, and there's no way you can say Apple magically avoided losses, because Google had similar losses. There is a reason that none of the assistants have really improved as much as you'd expect over a decade+, it's not profitable, and not only that, but it's also -extremely- expensive. Microsoft basically just gave up on it; not really because of market share, but because it made no money, was expensive, and had limited value to customers.

https://arstechnica.com/gadgets/2022/11/amazon-alexa-is-a-co...

https://arstechnica.com/gadgets/2022/10/report-google-double...

https://www.theverge.com/22704233/siri-apple-digital-assista...

https://www.msn.com/en-us/news/technology/the-failure-of-ama...

Re: Google's Bard shows incorrect information in its launch ad

#48
post #38
post #10

Earlier quoted context omitted.

We fact check search engine results all the time. But most of the time, such fact checking is in the form of looking at a result, considering whether it seems like a credible source, seeing if multiple credible-seeming results have the same answer, etc. Getting a completely untrustworthy, unsourced response seems worse than useless. Google has been going this way for a while, with its instant answers or whatever, but…

For the record, the “New Bing” AI results will not be unsourced but with key facts in sentences tagged in Wikipedia style, pointing towards the source URL. Finally, below the reply there will be a domain summary for an overview but where each domain name is clickable to get to the respective articles on said domains. In this case, Bing AI will operate very differently from ChatGPT.

In which case we would expect an LLM-based system to output something like,

"(Fact that isn't true)[Source that does not make that claim but comes close enough that you wouldn't notice it just by skimming]"

leading to even more people thinking it's true than otherwise.

Re: Google's Bard shows incorrect information in its launch ad

#49

Earlier quoted context omitted.

> lose these companies money How can you say Siri loses Apple money? Does GarageBand lose them money? Photo Booth? Contacts?

By that logic Alexa can't lose Amazon any money because it's baked into their products. But in fact, it's a massive money suck. It lost $10B last year, and there's no way you can say Apple magically avoided losses, because Google had similar losses. There is a reason that none of the assistants have really improved as much as you'd expect over a decade+, it's not profitable, and not only that, but it's also -extremel…

How hard do you really think it is to build intents into something like Siri once you have the underlying technology framework?

Yes I have experience building intents on top of something like Siri.

Re: Google's Bard shows incorrect information in its launch ad

#50

This is a great illustration of the risks of LLMs. As a user, if I am asking this question to a search engine, I definitely do not expect to need to fact-check the results. That's the whole reason to use the search engine in the first place! We're about to enter a dark ages of crappy AI products that are touted as game changing, outcompeting each other to be the best chatbot that can compose haiku about how grapes tu…

You trust everything you find on search engines?
Post reply on HN