Live data from Hacker News

GPT-J-6B: 6B JAX-Based Transformer

arankomatsuzaki.wordpress.com

41–50 of 84 posts

Re: GPT-J-6B: 6B JAX-Based Transformer

#41
post #8

Sorry guys, I think I broke it. I wanted to test it on my motivational speech, Even moving the ball forward is a win at this company, so I wouldn’t worry too much. You are in what’s called a blood pit. This is a room in most abattoirs below the killing floor where runoff of various kinds is collected for purposes of selling to the protein shampoo industry (mostly). Above you is a grated floor where cows roam around u…

This sounds like a verbatim copy of something I’ve read on Reddit a few years ago.

Re: GPT-J-6B: 6B JAX-Based Transformer

#42
post #25
post #23

I get the feeling that now that it's so easy to generate text that sounds legit and is syntactically correct but makes no sense semantically, web search will be unusable soon. Searching for answers to an obscure problem with a software library now already leads to 5 Stack Overflow ripoff sites that at least contain the same text like the original. If these scammers can now generate their own texts (randomly including…

Oh my god. I fed that text to the model and asked what we can do about this. Here are its answers: It is not so much the search engines that are at risk, but the people themselves. In a world where anyone with a $0.05 budget can just make something up, nobody will be able to trust anything anymore. It is not the search engines that will change the way we search, it will be the people, who will stop trusting anything…

Yeah you wrote that it made no sense semantically but it does, it rewrote your exact argument. This is great for a non native speaker for example, to rewrite a paragraph in a more standard language. Plagiarism will definitely be harder/impossible to detect.

Re: GPT-J-6B: 6B JAX-Based Transformer

#43
post #7

Earlier quoted context omitted.

I input the following: "dogs are superior to cats in every way". and the model generated the following... dogs are superior to cats in every way. They are better at watching TV, they are better at using their tails as fans, they are better at eating out of bowls, they are better at watching over children, they are better at giving head, they are better at being pets, they are better at eating on command, they are bet…

I agree with ALL of the above.

Better at giving head?

Re: GPT-J-6B: 6B JAX-Based Transformer

#44
Was it trained on IRC? This is what I got:

is your job going to be nonexistant

for 12 years?

hi all

someone please help me with this, I have windows 7 on a usb and when i boot from it my ubuntu 10.10 iso does not start. when i go to my bootloader in my usb and select the install option i get a grey screen with a green bar going across and it

never loads. i have the i386 option. help. thanks

When I boot my computer after a fresh install, it takes forever for the system to come up and I don't see any messages displayed. I have a dual-boot setup - Win7 and Ubuntu 10.04, and I think that this is the root of the problem. How can I troubleshoot what's going on and fix this? Should I somehow switch to Grub instead of using the Win7 bootloader?

can anyone tell me how to install jre on ubuntu 10.04

raju: Please don't flood, use http://paste.ubuntu.com to paste, don't use Enter as punctuation.

Hello

I want to

Re: GPT-J-6B: 6B JAX-Based Transformer

#45
post #7

Earlier quoted context omitted.

I input the following: "dogs are superior to cats in every way". and the model generated the following... dogs are superior to cats in every way. They are better at watching TV, they are better at using their tails as fans, they are better at eating out of bowls, they are better at watching over children, they are better at giving head, they are better at being pets, they are better at eating on command, they are bet…

I agree with ALL of the above.

I'll admit I don't particularly want to think about dogs giving head (I can't stop laughing)

Re: GPT-J-6B: 6B JAX-Based Transformer

#46
Crikey, What a lot of fun! Thanks to Eleuther for making this available to play with!

Here's my prompt (I'm into fractals, and I have a feeling that neural nets are loosely exploring in some fairly fractal spaces internally so I thought why not see where it went?):

"Fractals are synthetic or abstract objects, that have the property of self-similarity,"

Result (with temperature at 1.5):

Fractals are synthetic or abstract objects, that have the property of self-similarity, namely that if one portion of the fractal is magnified, it appears exactly like a portion of the fractal itself. It is considered the skeleton of chaos. (Displaying Fractals In art/science/film is expected)Fractals may be abstractly or concretely viewed, painted, sculptured, illustrated or can also be processed through visual media such as cartoons, magazines and animated films, the comic book etc.Though visual depiction is not very vital it may help the audience to take a visual understanding of fractals.When being considered or used, they are very often explored by artists with the power of creating, which means that often-constructed theories and hard labors can be encapsulated through some imaginary concept, man.It is obvious that in today’s technological world fractal geometry or non-Euclidean geometry is gradually becoming and becoming an amazing reality in itself, through special engines developed by people which act like fractal or cosmic molecules.After decades, now people understand the science of fractals and this science creates the equations for identifying areas that become areas of detail or have areas of smooth contours that allow shapes such as spheres, polygons or egyptian shaped icons or mathematic shapes in terms of area.

I loved that little ", man." bit.. made the whole thing transform to being read by "The Dude" from The Big Lebowski! Hilarious complete nonsense! love it!

Re: GPT-J-6B: 6B JAX-Based Transformer

#47
post #38

Earlier quoted context omitted.

Google uses a lot of other signals besides page content to rank search results. Common examples: 1. Links from well-ranked pages. 2. Whether the user hits the back button or stays on the page. Many of these should still work.

But they obviously don't work! That's why I mentioned all those Stack Overflow rip off sites as an example. When scrolling the results, my brain filters them out because I can recognise them as scam, but if they would contain unique and relevant text (generated by an AI), I'd be lost.

I actually like the stack overflow rip off sites. They load quicker than the real stack overflow (which often seems to freeze due to broken ad scripts).

Re: GPT-J-6B: 6B JAX-Based Transformer

#48
These are always fun to play with. I coaxed it to write a poem, which had a curious disclaimer attached:

  I learned to read and write
  Before I could spell the word "face"
  If you never learn to look
  You'll get nowhere at all
  I taught myself Spanish
  Before I knew how to say "disco"
  If you don't like the rain
  You need not go outside
  I'm learning to dance
  Before I know how to rhyme
  If you never try
  You will never know
  And if you do everything you can
  You will never know why
  
  Disclaimer:
  Opinions expressed in blog comments or posts do not necessarily reflect the views or policies of The Gourmet Live.

Re: GPT-J-6B: 6B JAX-Based Transformer

#50

I took one of the questions from this article: https://blog.seekwell.io/gpt3 Instruction: Given an input question, respond with syntactically correct PostgreSQL. Be creative but the SQL must be correct. Input: how many users signed up in the past month? And it gave me a pretty nonsensical answer compared to the output from GPT-3 seen in that article.

I haven’t properly investigated their dataset they trained on this, but from the responses it gives I would bet that they dataset is skewed towards news articles, press releases, and infomercial or edutainment copy. It does really well when it can write a long impersonal article about something, but doesn’t seem good at the random sort of things GPT3 can do like autocompleting source code.
Post reply on HN