I would love to see a youtube series of coders going through the process of getting a dataset and refining it into these as outputs. Probably not possible as a livestream but looking at the iterative process of doing the model development, eventually getting to the final generative process. (Brownie points for the web app part for web app dev neophytes :)
This word does not exist
231–240 of 432 posts
Re: This word does not exist
#232Author here! Funny to see this at the top of HN today -- happy to answer any questions (source code is here https://github.com/turtlesoupy/this-word-does-not-exist ) Shameless plug for my other "this x does not exist": This Fucked Up Homer Does Not Exist https://www.thisfuckeduphomerdoesnotexist.com/
You might need some filtering. I got the following output for my 7th or 8th try (I did s/ig/*/g because I hate typing this): noun. n*gerbar n*·ger·bar a bar from which the beer and liquor are sold "that party got a whole lot cooler this week with a n*gerbar refreshment" a word that does not exist; it was invented, defined and used by a machine learning algorithm.
It's hilarious that not even this GPT side project can escape the need for OpenAI-style output filtering.
Someone really ought to make an open source lib to solve this once and for all...
Re: This word does not exist
#233Earlier quoted context omitted.
I was starting to write a response, and realised how patterned the debate is. We've been discussing the topic of machine intelligence since the start of CS and points of contention tend to show up in the same places. Anyway, it occured to me that if given 10 tries, GPT-3 probably produces my comment adequately. I have an uneasy suspicion that it might take fewer tries than that... especially if prompted with "netcan,…
I'm on the "if you can't tell the difference..." side, too, but the issue is the "10 tries" and the prompting. GPT-3 has no ability to revise or reconsider or judge anything it writes. We're still safe, IMO, until the main loop goes >generate 10 "netcan comments" >drop 5 least conformant results >reword remaining comments several times >reassess rewordings, select best of each set >select 1 most conformant "netcan co…
this is the only way to reliably use GPT-X in a production setting. you have to postprocesses the responses with a second model, until you find one that is 1) reasonable 2) coherent 3) related to the topic of the prompt
Re: This word does not exist
#234Earlier quoted context omitted.
You might need some filtering. I got the following output for my 7th or 8th try (I did s/ig/*/g because I hate typing this): noun. n*gerbar n*·ger·bar a bar from which the beer and liquor are sold "that party got a whole lot cooler this week with a n*gerbar refreshment" a word that does not exist; it was invented, defined and used by a machine learning algorithm.
It's hilarious that not even this GPT side project can escape the need for OpenAI-style output filtering. Someone really ought to make an open source lib to solve this once and for all...
filtering objectionable content actually requires you to build a strong AI model capable of being offended itself, so it knows to hold its tongue in mixed company
edit: lest i leave this comment totally useless, the chatbot engine “chatscript” has pretty good capabilities for disambiguating word meaning and classifying the meanings into “badword” and “verybadword” - its free/libre software and very high performance.
Re: This word does not exist
#235OMG, this can't be claimed as never existing, what if it starts to exist, this is too realish:
https://www.thisworddoesnotexist.com/w/microtoxin/eyJ3IjogIm...
Re: This word does not exist
#236 noun.
kölsch
1. unwanted drinking in or as a means of controlling one's drinking
Re: This word does not exist
#237Author here! Funny to see this at the top of HN today -- happy to answer any questions (source code is here https://github.com/turtlesoupy/this-word-does-not-exist ) Shameless plug for my other "this x does not exist": This Fucked Up Homer Does Not Exist https://www.thisfuckeduphomerdoesnotexist.com/
How long did it take to train this GPT-2 based model?
It's a refinement of a lightweight version of GPT-2 by Hugging Face -- https://huggingface.co/transformers/model_doc/gpt2.html. I don't recall exact numbers, but once I had the structure of the problem right (i.e. sequencing words, part of speech and definitions) it was around 12 hours on my old 1080 TI.
Re: This word does not exist
#238Author here! Funny to see this at the top of HN today -- happy to answer any questions (source code is here https://github.com/turtlesoupy/this-word-does-not-exist ) Shameless plug for my other "this x does not exist": This Fucked Up Homer Does Not Exist https://www.thisfuckeduphomerdoesnotexist.com/
Ahh, and you've made the wise decision to NFTify the fucked up Homers! Nothing says "investment vehicle" like-- hey, wait a minute!! That's a fucked up Bart ! Good day , sir! [0] https://opensea.io/assets/0x495f947276749ce646f68ac8c2484200...
Alright! Someone shilling on my behalf. Say what you want about NFTs, every time I see one of the homers sell it brings a big smile to my face.
Re: This word does not exist
#239Author here! Funny to see this at the top of HN today -- happy to answer any questions (source code is here https://github.com/turtlesoupy/this-word-does-not-exist ) Shameless plug for my other "this x does not exist": This Fucked Up Homer Does Not Exist https://www.thisfuckeduphomerdoesnotexist.com/
Please say you take requests.
Press "write your own" and it'll make up a definition for you :)
Re: This word does not exist
#240Author here! Funny to see this at the top of HN today -- happy to answer any questions (source code is here https://github.com/turtlesoupy/this-word-does-not-exist ) Shameless plug for my other "this x does not exist": This Fucked Up Homer Does Not Exist https://www.thisfuckeduphomerdoesnotexist.com/
You might need some filtering. I got the following output for my 7th or 8th try (I did s/ig/*/g because I hate typing this): noun. n*gerbar n*·ger·bar a bar from which the beer and liquor are sold "that party got a whole lot cooler this week with a n*gerbar refreshment" a word that does not exist; it was invented, defined and used by a machine learning algorithm.
Ah crap, good call. I did a first-pass at filtering for the ones displayed on the site but my regex must have had some misses.