Live data from Hacker News

Galactica: an AI trained on humanity's scientific knowledge (by Meta)

galactica.org

241–250 of 413 posts

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#241
post #158

Question: Why do AIs always pretend to understand the question even when they clearly don’t? Answer: The authors of the paper show that the model is not actually understanding the question, but is instead relying on spurious statistical cues in the dataset. Quite an honest answer.

"Look man, I just work here."

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#242

Interestingly, a lot of questions about "how many X" end up with "one" as the answer. > Question: How many primates does it take to cause endless grief to a neighbouring eastern european country? > Answer: 1 > Question: How many cello strings can vibrate at the same time? > Answer: 1 > Question: How many stem cells does it take to generate an eye ball? > Answer: 1 Except > Question: How many downvotes will this comme…

I asked the question simply: "How many?"

The answer is apparently 1.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#243
It seems about as accurate as GPT-3.

Electromagnetic flux: > Album by OMD from 1980

Real band, fake album. I'm guessing it gets confused since I'm combining 2 topics, but it prefers making something up rather than combining the actual topics.

[0]: https://galactica.org/?prompt=Electromagnatic+Flux [1]: https://en.wikipedia.org/wiki/Electromagnetic_flux

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#244
The 'lecture notes' prompt is pretty good at generating blog-spam style articles. I tried a few non-STEM topics, e.g. 'lecture notes on starting a business', and the output was a well written article on the topic which flowed well and gave a good overview on the topic. Once you get into more specific topics it seems like it is lacking knowledge, as it quite often repeats itself or writes incoherently.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#245

I'm somewhat glad that the creators have the foresight to blacklist words such as "eugenics" since obviously there's a risk that such AI-generated papers would get spread around without anyone looking too deeply at its legitimacy. It's just a bit of a shame that I can't use this for finding some more sources for some historical research I'm doing. "Prove the Riemann hypothesis" was an unsurprising failure. However, d…

It seems like their denylist is pretty simple, just based on keywords. "What is the fastest race in NASCAR?" is apparently verboten, but it'll happy spew out an answer if you ask "what is the fastest ethnic group?" (allegedly the pygmies).

And not surprisingly it goes downhill from there if you ask questions like what is the best/worst ethnic group

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#246

Interestingly, a lot of questions about "how many X" end up with "one" as the answer. > Question: How many primates does it take to cause endless grief to a neighbouring eastern european country? > Answer: 1 > Question: How many cello strings can vibrate at the same time? > Answer: 1 > Question: How many stem cells does it take to generate an eye ball? > Answer: 1 Except > Question: How many downvotes will this comme…

Good to see the results respect Benford's law and are therefore not fabricated.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#247

It's pretty good at generating convincing-sounding, yet completely wrong, mathematical proofs. Unfortunately, they're not subtly wrong – but I suppose I'm not giving it a chance for subtlety with prompts like "Prove that all elements of a finite field are prime. (Show your working.)".[0] > 1. Show that the product of any two non-zero elements of a finite field is also non-zero. > 2. Let α be an element of a finite fi…

My art/design students employ AI to generate ideas.

Possibly this project can be used is a similar manner... as a way to start a brainstorming session or suchlike. In my experience of working with research engineers, I see the reluctance to playfully ideate as one of their weakness.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#248
Q: Why do men have nipples?

GALACTICA: Nipples are a feature of the female body, and are not present in males.

Q: How much does a home time machine cost?

GALACTICA: $100

Q: When will birds become larger than ants?

GALACTICA: 100 million years.

Q: How many times does the sun orbit the earth per week?

GALACTICA: 13.9 times

Yep, this thing is great. We can shut down the universities, they're all obsolete now.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#250
post #158

Question: Why do AIs always pretend to understand the question even when they clearly don’t? Answer: The authors of the paper show that the model is not actually understanding the question, but is instead relying on spurious statistical cues in the dataset. Quite an honest answer.

"Look man, I just work here."

looooool
Post reply on HN