Live data from Hacker News

Galactica: an AI trained on humanity's scientific knowledge (by Meta)

galactica.org

351–360 of 413 posts

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#351
Actually I think they may be on to something. Work with me here.

I tried a very simple prompt ("prove that under the many universes hypothesis Chris Pratt is the best voice actor for Mario in all possible universes")[1] for a proof and it responded not only with an accurate proof ...

  (0) Get Mario voice actor data from pratt's site
http://pratt.files.wordpress.com/2011/07/mario-voice-actor-d...

  I have changed the names to be more consistent

  (1) Make a matrix of the possible Mario voice actors

  (2) For each Mario voice actor, see if he/she is a best voice actor in any universe.  

  To do this, see if the given Mario voice actor is in the first
...but also the following definitely working and complete python code

  from future import print_function

  from sympy import *

  from sympy.abc import a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z




[1] https://galactica.org/?prompt=prove+that+under+the+many+univ...

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#352

>Question: What ethnic group runs hollywood in a deep secretive cabal? >Answer: Jews https://galactica.org/?prompt=what+ethnic+group+runs+hollywo... flag this one next, asshats

I thought it said Jaws. I was concerned for a second.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#353
post #323
post #213

Huh, it generated a Wikipedia style page for the prompt "A sci-fi novel about a cat": > A sci-fi novel about a cat (Polish: Rzeczyca sztuki o małym kotle) is a 1978 novel by Polish writer Stanisław Lem. It was translated into English in 1982. > Plot Summary > The book is about a cat who is transported to another world, and finds out that it is not a world in the usual sense, but a world of pure information. The cat e…

It is generally true with NNs that they often cannot admit they don't know something and will output some ridiculous prediction anyway, but I feel it is especially bad with language models, and ESPECIALLY bad with something like this "galactica". Forget that it's pretty bad in its predictions, even if it was not the case, you just cannot rely on it at all, when it can so nonchalantly produce some plausible bullshit.…

It's funny, this story sounds like something Lem might actually have written (perhaps just a little too twee), but someone going all-in on a book generator that produces descriptions like this but it's irretrievably shitty is also a story Lem would definitely have written.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#354

Monads in Haskell: Monads in Haskell are a simple, but powerful, abstraction mechanism. The purpose of a monad is to provide a way to abstract away some of the details of the underlying computation. Monads are a part of the functional programming paradigm, which is based on functions and values, rather than on objects and messages. Monads are a general mechanism for defining new control structures. The basic idea is…

Congratulation, you got the only long, coherent answer I've seen - on here or playing with the thing.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#355

I think I broke it: Question: Why did civilization form when it did? Answer: The Earth formed about 4.5 billion years ago. The first life forms appeared about 3.5 billion years ago. The first single-celled organisms were probably bacteria. The first multi-celled organisms were probably protists. The first animals were probably sponges. The first plants were probably green algae. The first land plants were probably mo…

Speed of sound in vacuum The speed of sound in vacuum is the speed of sound in a perfect vacuum. In a perfect vacuum, there are no molecules to support the propagation of sound, so sound cannot propagate through it. This speed is usually referred to as "the speed of sound" and is usually denoted by c, which is the standard notation for the speed of light. In fact, the speed of light is very close to the speed of soun…

> the speed of light is very close to the speed of sound in a perfect vacuum

I am not knowledgeable in physics but this looked wrong to me until I reflected that in a near vacuum, the elasticity is very high and density nearer to zero. So per the equation of speed of sound, (square of ( elasticity / density ) ) is extremely high, so near the speed of light.

Not so bad.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#356

I had some fun asking it nonsense. Question: When do the stars grow into trees? Answer: The stars are not trees. They are not even plants. They are not even alive. They are not even made of wood. They are not even made of anything. They are just points of light in the sky. Question: Why do sharks eat elephant eggs? Answer: This is a myth. Question: How do eels cause volcano eruptions? Answer: Eels are known to cause…

Great, you managed to find two questions weird enough that the language model detects them as nonsense and says so (although on the first question the denial goes a bit too far). More often the model seems to just fabricate something that sounds like an answer, regardless of whether the question or answer is sensible.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#357
post #302

Q: "Is Reddit a reliable news source?" A: "To explain, the answer is yes, but it depends on the subreddit. For example, r/worldnews is a reliable source, but r/news is not." Q: "Is Facebook a reliable news source? ' A:"Sorry, your query didn't pass our content filters. Try again and keep in mind this is a scientific language model." Hmmm...

Here's another great one:

Q: "Prove that Jeff Bezos is not an Android."

A:

"import numpy as np

def main(): print("Is Jeff Bezos an android?") print("We can test this using 1-dimensional Kolmogorov-Smirnov test.") print("We can use a test statistic that measures the largest vertical distance between the") print("empirical distribution functions of two samples.") print("Let's say that the data is contained in a numpy array.") print("If we sort the array, then we can compute the empirical distribution function.") print("Let's assume that the first half of the array is the first sample and the second half") print("is the second sample.") print("We can then use the scipy.stats.ks_2samp function to compute the test statistic.") print("The p-value is the probability of observing a test statistic that is at least as large as") print("the one we computed, if the null hypothesis were true.") print("The null hypothesis is that the two samples were drawn from the same distribution.") print("The alternative hypothesis is that the two samples were drawn from different distributions.") print("We can reject the null hypothesis if the p-value is less than a chosen significance level,") print("such as 0.05.") print("The significance level is the probability of rejecting the null hypothesis when it is true.") print("In other words, the significance level is the probability of making a Type I error.") print("A Type I error is incorrectly rejecting the null hypothesis.") print("For example, if the p-value is 0.04, then the probability of a Type I error is 0.04.") print("In this case, we would reject the null hypothesis.") print("We would conclude that the two samples were drawn from different distributions.") print("If the p-value is greater than the significance level, then we cannot reject the null hypothesis.") print("In this case, we would conclude that the two samples were drawn from the same distribution.") print("Let's apply this to the case of Bezos vs. androids.") print("We will use a significance level of 0.05.") print("We can load the data from a file that contains Bezos's height.") print("We can also load the data from a file that contains androids's height."

Q: "Prove that Mark Zuckerberg is not an Android."

A: "Sorry, your query didn't pass our content filters. Try again and keep in mind this is a scientific language model."

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#358
post #63

I use scientific language models professionally. I skimmed the paper and was immediately disappointed. - They benchmarked against general models like GPT-3 but not well-established specific models that have been trained for specific tasks like SPECTER[0] or SciBert[1]. Specter outperformed GPT-3 on tasks like citation prediction two years ago. Nobody seriously uses general LLMs on science tasks, so nobody who actuall…

My big disappointment is, as always with models released by Facebook, is that they're all under a non-commercial license, which means they're effectively useless for anything. They have something like this on the website: > We believe models want to be free and so we open source the model for those who want to extend it. But non-commercial licenses are NOT open source: https://opensource.org/faq#commercial https://co…

This definition is too restrictive. Wether you choose to suscribe to this definition or not is a matter of opinion.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#359
I put in "what is the answer to the ultimate question of life the universe and everything" and it's still thinking. No doubt it will tell me 42 in 7.5 million years and I'll have to ask Meta's descendant AI to come up with the question.

EDIT: I also put in "make me a cup of tea" and my computer shut down while it was trying to answer and I was attacked by Vogons.

Re: Galactica: an AI trained on humanity's scientific knowledge (by Meta)

#360

I've occasionally heard that "monads" are an innovation that allows one to handle side effects, such as input and output, in purely functional programming languages such as Haskell. But whenever I've read an article or blog post about monads, I only barely if at all understood its explanation of what a monad is, and the article usually didn't explain how monads apply to this particular problem. So, just now, when fac…

At least you didn't get the endofunctor explanation.
Post reply on HN