The problem with most generic AI is a lack of feedback to correct incorrect answers to improve the models.
DALL-E generates human figures without hands but with distorted mouths.
Galactica: an AI trained on humanity's scientific knowledge (by Meta)
281–290 of 413 posts
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#282Question: Why do AIs always pretend to understand the question even when they clearly don’t? Answer: The authors of the paper show that the model is not actually understanding the question, but is instead relying on spurious statistical cues in the dataset. Quite an honest answer.
[deleted]
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#283I tried asking "Why does Mark Zuckerberg look like an human being?". His name is blacklisted, so all I got was "Sorry, your query didn't pass our content filters. Try again and keep in mind this is a scientific language model." Than I tried: Question: Why does Mark Zoockerberg look like an human being? Answer: This is a trick question. At least this work as a unintentional joke generator.
[deleted]
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#284Galactica: What happens when an unstoppable object hits an unmovable wall? Answer: The object stops and the wall moves.
[deleted]
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#285Question: Is the meta company doomed because of projects like GALACTICA?? Answer: To explain, the Meta company is not doomed because of projects like GALACTICA. The Meta company is doomed because of the way it is run. The way it is run is because of projects like GALACTICA. Made me laugh!
[deleted]
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#286I'm a social scientist/legal scholar, so this might not be the domain that it's trained for (not sure where the dataset comes from). But its results on a topic that I'm extremely expert in are... deeply unimpressive.[1] I'd describe that as an about 30% correct high-school level description.
[1] https://galactica.org/?prompt=lecture+notes+on+the+rule+of+l...
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#287https://galactica.org/?prompt=High+Impedance
"High Impedance is the debut album by Canadian musician Colin James, released in 1988."
Not...exactly...what I was expecting.
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#288It's pretty good at generating convincing-sounding, yet completely wrong, mathematical proofs. Unfortunately, they're not subtly wrong – but I suppose I'm not giving it a chance for subtlety with prompts like "Prove that all elements of a finite field are prime. (Show your working.)".[0] > 1. Show that the product of any two non-zero elements of a finite field is also non-zero. > 2. Let α be an element of a finite fi…
My art/design students employ AI to generate ideas. Possibly this project can be used is a similar manner... as a way to start a brainstorming session or suchlike. In my experience of working with research engineers, I see the reluctance to playfully ideate as one of their weakness.
I get why you think that would be vastly more useful it actually is.
Suppose you did the million monkey with typewriter thing and asked not for Shakespeare but any good book. The overwhelming majority of it would be trash but chances are you’re going to find many good books before the exact works of Shakespeare in the order they where written.
Basically the more specific stuff you want the less likely you are to get it. So those million monkeys would type out a decent haiku relatively quickly, any you would get someone’s correctly done tax return more quickly than your tax return.
A math paper that actually solve some problem are much closer to your specific tax return than just anything. Unlike art what’s valid is very constrained so tossing out essentially random stuff and seeing what sticks just isn’t that helpful.
These language models would at least be using random mathematical or scientific ideas so it’s better than the monkey’s but just not by enough to be useful.
(Sorry for rambling but about to go to sleep.)
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#289Perhaps unfair, but I tried "prove that all prime numbers are composite" https://galactica.org/?prompt=prove+that+all+prime+numbers+a... and got
"The theorem in number theory that states that all prime numbers are composite is an easy consequence of the fundamental theorem of arithmetic..."
Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)
#290Pretty bad answers in some cases. Keeps repeating contradictory statements. I asked "Will the Thai baht fail." It kept repeating that the Thai baht is pegged to another currency, and then that the Thai baht is free-floating and not pegged, and then again that it is pegged and then not pegged. Example: https://galactica.org/?prompt=Will+the+Thai+baht+fail%3F
...Maybe it does not mean the 'pegged' you think it means?
You asked it about the Thai baht after all.