Question, did anyone check whether the AI was prompted to generate something like this? I don't know anything about TSAM. Was it asked to, "Write a fake piece about the population of Mars"? I agree with most of the concerns you all have raised about AI, but if we didn't even check whether the AI malfunctioned, I'd say all of the comments discussing how "AI will be the death of facts" are just as devoid of facts as the AI, lol (No offense meant to those comment writers. I'm not sure if they missed this or not, but if so, it's an easy mistake to make). Honestly, I'd say most people are wrong from not fact checking their information more often than the current generation of AI is wrong from the kinds of errors AI is prone to on most non-specialized subjects.
Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
81–90 of 94 posts
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#82Question, did anyone check whether the AI was prompted to generate something like this? I don't know anything about TSAM. Was it asked to, "Write a fake piece about the population of Mars"? I agree with most of the concerns you all have raised about AI, but if we didn't even check whether the AI malfunctioned, I'd say all of the comments discussing how "AI will be the death of facts" are just as devoid of facts as th…
Since I didn't see anyone link the original article that Bing pulled the information from, here it is https://tsam.net/what-is-the-population-of-mars/. This editor responsible for this piece on TSAM pretty well only posts these kind of nonsense articles (https://tsam.net/how-cold-is-ice/, https://tsam.net/crocodile-underwater/). It is funny that Bing grabbed one of his nonsense articles, but my guess is that the editor is purposefully prompting the AI to produce nonsense, which doesn't really say much about the factuality of AI.
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#83Question, did anyone check whether the AI was prompted to generate something like this? I don't know anything about TSAM. Was it asked to, "Write a fake piece about the population of Mars"? I agree with most of the concerns you all have raised about AI, but if we didn't even check whether the AI malfunctioned, I'd say all of the comments discussing how "AI will be the death of facts" are just as devoid of facts as th…
Since I didn't see anyone link the original article that Bing pulled the information from, here it is https://tsam.net/what-is-the-population-of-mars/ . This editor responsible for this piece on TSAM pretty well only posts these kind of nonsense articles ( https://tsam.net/how-cold-is-ice/ , https://tsam.net/crocodile-underwater/ ). It is funny that Bing grabbed one of his nonsense articles, but my guess is that the…
I looked into the site. From what I could tell and given the timeline, it looked like the person was using an older model of text generation to create this spam at the time. The one about crocodiles being without scales and being slow and ocean dwelling but also being somehow active is the kind of nonsensical zero context preserving stuff gpt used to generate before the gpt 3 model released.
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#84Obviously, the question[1] had to be asked: "What is the population of Uranus?" > 25 residents > Uranus has 25 residents but no formal local government and states on the entrance sign, "It's Not a Town, It's a Destination." [3] And it is correct, up to Wikipedian facticity standards: https://en.wikipedia.org/wiki/Uranus,_Missouri 1: http://www.bing.com/search?q=What+is+the+population+of+Uranu...
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#85Earlier quoted context omitted.
AI doesn’t have the capacity to think critically.
it really does tho https://arxiv.org/abs/2201.11903 just in a limited capacity
It really doesn't. It's a language model. Literally every webpage on this topic mentions that.
This is why it will happily tell you that a director directed a movie before they were born, and agree with you when you point that out, and continue to insist that he did it. There is no ability to synthesize and apply new information to a line of reasoning, because the chain of thought is an illusion wrought by a statistical language model.
Its purpose is to be semantically correct, not to reason.
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#86I guess the way forward will have to be giving the neutral network access to a curated database of facts as suggested by Stephen Wolfram: https://writings.stephenwolfram.com/2023/01/wolframalpha-as-... The internet is simply too full of nonsense.
Imagine suggesting a literal plotpoint from an Orwell novel with a straight face on hackernews.
Dont forget to update the Wolfram database with who we're at war with!
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#87It is big data all over again. Supposedly with so much data we can know everything. But there was no way of knowing if that data was any good. Garbage in garbage out.
The tech field is the sad story of execs, marketing types, and end users continually relearning the lessons that they refused to accept from the developers.
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#88Earlier quoted context omitted.
it really does tho https://arxiv.org/abs/2201.11903 just in a limited capacity
It really doesn't. It's a language model. Literally every webpage on this topic mentions that. This is why it will happily tell you that a director directed a movie before they were born, and agree with you when you point that out, and continue to insist that he did it. There is no ability to synthesize and apply new information to a line of reasoning, because the chain of thought is an illusion wrought by a statisti…
[deleted]
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#89Earlier quoted context omitted.
it really does tho https://arxiv.org/abs/2201.11903 just in a limited capacity
It really doesn't. It's a language model. Literally every webpage on this topic mentions that. This is why it will happily tell you that a director directed a movie before they were born, and agree with you when you point that out, and continue to insist that he did it. There is no ability to synthesize and apply new information to a line of reasoning, because the chain of thought is an illusion wrought by a statisti…
show me Reason that is not axiomatically embedded in language.
for anything else, how can you possibly know it's not operating on a (massively) complex statistical model? are you gonna ask it? if you do science on it to discover it's complexity, why is the computationally shorter method to achieve the same results any worse or less authentic?
it's like saying the closed form solution of a summation isn't "really" a summation either
finally, you are letting the word "semantically" do a lot of work for you.
Re: Bing thinks Mars has 2.5B people based on an AI generated blog wrong answer
#90What is more interesting for me, is why anyone is surprised that an algorithm based on choosing a statistically probably combination of words, trained with whatever random crap appears on the internet, happens to choose some combination that makes grammatical sense, but doesn't match reality.
Because it was not trained with bias in favor of "reality" or facts but grammatical sense. Given that gpt is a statistical model in theory it should be possible to bias towards facts, but that means being able to identify bs from facts. This is a subject on its own.
Do you think it’s even possible? Imagine written facts as a thick thread and bs as long hairs growing from it (both written and hallucinated, there’s no limit for bs). We can ask something very well-known and likely(?) the answer will stay within that thread. But if you ask something non-trivial, i.e. start in the hairy area, which force could drive its “thinking” back into the thread? I believe that there’s no way to create it (in this model). Once far away from the main road, LLMs can wander bs space indefinitely. If my analogy makes sense at all, obviously.