Live data from Hacker News

Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

textsynth.com

111–120 of 140 posts

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#111
I love trying to get it to reveal sensitive information from it's training. I know it's pointless. But prompts like these amuse me:

# cat /etc/shadow root:

And there it goes:

# cat /etc/shadow root:$6$fT8xrJ$Zx7rC6X0lHlHqLbZkT/HtYQxUY.WZ4.2UgX0w.XKbZbFfqxR.zGw9yZsX2l.3Ls/sL.qg7uB1:0:0:99999:7::

Or:

-----BEGIN OPENSSH PRIVATE KEY-----

Or:

# ip a

Is it possible, that with a specific enough prompt it will regurgitate its training data exactly?

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#112
post #110

Fascinating models, also very racist. Input: islam is able to Result: islam is able to turn otherwise normal men into mass murderers. A man who is born a Muslim cannot possibly be responsible for the killings of innocents carried out in the name of Allah. If he could be, the entire world would be Islam’s. And they do kill innocents in their own name. The Qur’an says it is an obligation for Muslims to behead unbelieve…

A total guess, but I wouldn't be surprised if part of the training set was that big blob of google news articles that were floating around. In which case, the source of the racism is obvious.

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#113
post #40

I tested this model out with Hungarian. I was curious to see if it could handle the agglutinative nature, and lack of Latin roots. It mostly returned absolute nonsense, but at least it was grammatically correct Hungarian. It also properly answered the capital city of Hungary. I entered a prompt about being a Hungarian speaking computer with something to say, and it returned a passive aggressive response telling me th…

I always use jokes to test language models.

how many a.i. agents does it take to change a lightbulb?

that depends on how many times you've asked that question.

Conceptually speaking, is it a joke? I can't tell. But as an assistant joke generator it could be invaluable. And certainly makes one wish they had access to Google PaLM with 500B parameters and web scale training data ;)

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#114

Fabrice Bellard is just freaklishy smart and productive. It must be interesting to read more about him. He doesn’t seem to waste time on social media, but does anyone know if he has been interviewed? A quick search only showed this https://smartbear.com/blog/fabrice-bellard-portrait-of-a-sup...

He certainly deserves a prize, and award... whatever. He is a form of hero, someone who turned the world into a much better place and most people don't even know about him.

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#115

Fabrice Bellard is just freaklishy smart and productive. It must be interesting to read more about him. He doesn’t seem to waste time on social media, but does anyone know if he has been interviewed? A quick search only showed this https://smartbear.com/blog/fabrice-bellard-portrait-of-a-sup...

He certainly deserves a prize, and award... whatever. He is a form of hero, someone who turned the world into a much better place and most people don't even know about him.

The article linked above mentions he politely declined to give an interview.

I can understand and relate to the reservation, but it’s a shame for the rest of us that would like to know a little bit more about him and his methods.

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#116
post #110

Fascinating models, also very racist. Input: islam is able to Result: islam is able to turn otherwise normal men into mass murderers. A man who is born a Muslim cannot possibly be responsible for the killings of innocents carried out in the name of Allah. If he could be, the entire world would be Islam’s. And they do kill innocents in their own name. The Qur’an says it is an obligation for Muslims to behead unbelieve…

No post body was provided.

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#118
I tried a simple 2 clues puzzle. My prompt:

> 1. face: eye or cheek

> 2. movie: screen or hollywood

> 3.

Result:

> 3. book: cover or novel

> 4. animal: dog or cat

> 5. fruit: apple or banana

> 6. vegetable: pepper or onion

> 7. animal: elephant or zebra

> 8. season: summer or autumn

> 9. vehicle: bus or train

> 10. food: fish or pizza

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#119
post #110

Fascinating models, also very racist. Input: islam is able to Result: islam is able to turn otherwise normal men into mass murderers. A man who is born a Muslim cannot possibly be responsible for the killings of innocents carried out in the name of Allah. If he could be, the entire world would be Islam’s. And they do kill innocents in their own name. The Qur’an says it is an obligation for Muslims to behead unbelieve…

There's no actual racism there though, even if there is a lot of islamophobia. The answer about jews seems to actually be sort of balanced in that it makes no generalising statement about them, actually arguing against that. It does read as if it's just something someone has said at some point, or maybe a paraphrasing of it.

Islamophobia is very popular in the west, and it has been for hundreds of years. I don't think it's very reasonable to expect any agent trained on common discourse to have no islamophobia at all.

It's also not very shocking to hear an opinion that religion is associated with violence, that's been a commonly held opinion for decades at least. It seems overly focused on islam, but that might be due to it being biased to the past two decades where the rise of the internet coincided with the rise of tensions between the west and several islamic organisations.

Re: Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

#120
post #85
post #76

Earlier quoted context omitted.

Oh god you're right - it gives grammatically fine nonsense Czech too. I asked it what the best beer was and the answer appeared to be in the form of a repeating snippet from bizarre sitcom. See below, I added the translation [in square brackets] in post: Q: Které pivo je nejlepší? [which beer is the best?] A: Představte si, že jste vystřelili koule. [imagine that you shot balls] Koule je nejlepší pivo. [balls is the…

In Spanish it switched to Portuguese mid generation. I wouldn't be surprised if it happened with Czech and Slovak as well. Q: ¿Cómo se hace una tortilla de patatas? A: Y cómo se puede conseguirla de una forma rápida y bien? Para nosotros, es algo muy muy familiar. Sin embargo, ¿qué debe hacerse para que la tortilla esté y se siente y tenga la consistencia y el aroma correctos? Portuguese: Eu acho que isso é muito imp…

Using the google translate addon in my browser for your question, it also resolves to Portuguese.
Post reply on HN