Google's Bard shows incorrect information in its launch ad
1–10 of 234 posts
Re: Google's Bard shows incorrect information in its launch ad
#2There was a lot of stories like "Webb captures it's fist ever picture of an exoplanet" [eg]. My guess is that it's digesting those and not understanding that the "it's" in that sentence is critical.
Here is a prior example of an exoplanet picture: https://esahubble.org/images/heic0821a/
[eg] https://blogs.nasa.gov/webb/2022/09/01/nasas-webb-takes-its-...
Re: Google's Bard shows incorrect information in its launch ad
#3This is a great illustration of the risks of LLMs. As a user, if I am asking this question to a search engine, I definitely do not expect to need to fact-check the results. That's the whole reason to use the search engine in the first place!
We're about to enter a dark ages of crappy AI products that are touted as game changing, outcompeting each other to be the best chatbot that can compose haiku about how grapes turn into raisins.
Re: Google's Bard shows incorrect information in its launch ad
#4There was a lot of stories like "Webb captures it's fist ever picture of an exoplanet" [eg]. My guess is that it's digesting those and not understanding that the "it's" in that sentence is critical. Here is a prior example of an exoplanet picture: https://esahubble.org/images/heic0821a/ [eg] https://blogs.nasa.gov/webb/2022/09/01/nasas-webb-takes-its-...
Did you mean "its" such as in https://news.ycombinator.com/item?id=34359839>? Given your statement of this being critical... :) (Advice I also gave at work today: just don't use contractions and the right spelling will usually be obvious. In an informal setting, it's more tempting, but that's the way to easily check yourself.)
Re: Google's Bard shows incorrect information in its launch ad
#5Everytime I see someone finding something wrong about these things, I am reminded of Stoll in '95
https://www.newsweek.com/clifford-stoll-why-web-wont-be-nirv...
He also had some similar things in Cuckoo's Egg. I wish I could find the quotes, but there was something about email not working all the time and therefor pointless to use.
I'm glad people are finding all the flaws in ChatGPT and the LLM things now, but won't much of this be fixed as it gets better? From my very limited view, these things are amazing, and far from perfect, but damn the can do so much already.
I guess I'm not sure why there's such a rush to dismiss this, when it's clearly a game changer in its present form, and yet so very new (at least new to me).
Re: Google's Bard shows incorrect information in its launch ad
#6Everytime I see someone finding something wrong about these things, I am reminded of Stoll in '95 https://www.newsweek.com/clifford-stoll-why-web-wont-be-nirv... He also had some similar things in Cuckoo's Egg. I wish I could find the quotes, but there was something about email not working all the time and therefor pointless to use. I'm glad people are finding all the flaws in ChatGPT and the LLM things now, but won'…
I think there are two things to be aware of right now:
1) This technology is revolutionary and will change the world
2) This technology is very unreliable right now and should be seen as a tech demo rather than an actual assistant
(2) is a big problem. Kids submitting term papers with wrong information is one thing, but people are using ChatGPT for things that they shouldn't be, given how many mistakes it makes: https://www.law360.com/pulse/articles/1573108
Re: Google's Bard shows incorrect information in its launch ad
#7Everytime I see someone finding something wrong about these things, I am reminded of Stoll in '95 https://www.newsweek.com/clifford-stoll-why-web-wont-be-nirv... He also had some similar things in Cuckoo's Egg. I wish I could find the quotes, but there was something about email not working all the time and therefor pointless to use. I'm glad people are finding all the flaws in ChatGPT and the LLM things now, but won'…
However, Stoll was largely correct: the web is not Nirvana. Some structures persisted (e.g. Wikipedia) to help round off data correctness, albeit imperfectly, but his central concerns are just as valid today as they were in 1995.
As a user, the ability for a LLM to literally make things up and present them alongside other true data with no qualms or disclaimers is highly detrimental to the central use case.
Re: Google's Bard shows incorrect information in its launch ad
#8This is a great illustration of the risks of LLMs. As a user, if I am asking this question to a search engine, I definitely do not expect to need to fact-check the results. That's the whole reason to use the search engine in the first place! We're about to enter a dark ages of crappy AI products that are touted as game changing, outcompeting each other to be the best chatbot that can compose haiku about how grapes tu…
Frankly, I quite often fact check results I get from simple google queries.
But I do agree that adding another level of fake news generation is a solution in desperate need of a problem.
Re: Google's Bard shows incorrect information in its launch ad
#9I asked the same question to chatGPT, and it gave only future-looking statements, I guess because it was only trained on pre-JWST-launch data.
PROMPT: what new discoveries from the James Webb Telescope can I tell my 9-year old about?
ANSWER:
> Here are a few things that the James Webb Space Telescope (JWST) might discover that you could explain to a 9-year-old:
> Planets around other stars: JWST will be able to study exoplanets in more detail than ever before, potentially finding new ones and learning more about the conditions on their surfaces.
> The beginning of the universe: JWST will be able to observe some of the oldest stars and galaxies in the universe, helping us learn about how it all began.
> The formation of stars and planets: By observing the clouds of gas and dust where stars and planets are forming, JWST will help us understand how they are born.
> The secrets of distant galaxies: JWST will be able to observe the light from distant galaxies, giving us a window into their structures and evolution.
> The mysteries of black holes: By observing the material around black holes, JWST will help us learn more about these mysterious objects and how they shape their surroundings. Overall, the JWST will help us answer some of the biggest questions about the universe and our place in it.
Re: Google's Bard shows incorrect information in its launch ad
#10This is a great illustration of the risks of LLMs. As a user, if I am asking this question to a search engine, I definitely do not expect to need to fact-check the results. That's the whole reason to use the search engine in the first place! We're about to enter a dark ages of crappy AI products that are touted as game changing, outcompeting each other to be the best chatbot that can compose haiku about how grapes tu…
We fact check search engine results all the time. But most of the time, such fact checking is in the form of looking at a result, considering whether it seems like a credible source, seeing if multiple credible-seeming results have the same answer, etc.
Getting a completely untrustworthy, unsourced response seems worse than useless. Google has been going this way for a while, with its instant answers or whatever, but at least those try to cite a search result and you can read the surrounding context which Google got the result from.