GPT-J-6B: 6B JAX-Based Transformer
arankomatsuzaki.wordpress.com
GPT-J-6B: 6B JAX-Based Transformer
1–10 of 84 posts
Re: GPT-J-6B: 6B JAX-Based Transformer
#2Accompanying blog post https://arankomatsuzaki.wordpress.com/2021/06/04/gpt-j/
Re: GPT-J-6B: 6B JAX-Based Transformer
#3To test it out: https://6b.eleuther.ai/
Re: GPT-J-6B: 6B JAX-Based Transformer
#4To test it out: https://6b.eleuther.ai/
Some sample output I got (yes, this is real):
> You can travel through the universe to the furthest reaches of the unknown, where the background radiation of the early universe grows in intensity as you go further and further away from where you started. Somewhere beyond that radiation lie the last remnants of the beginning of the universe. Here there is an ‘ultimate singularity’, an instant of time that doesn’t have a name. At that point the laws of physics as we know them all break down. There is no matter, energy, or anything else; there is just an unbound, unmeasurable amount of energy.
> The laws of physics are fundamental constants that set the parameters of our world. But they seem arbitrary, without foundation. What if the laws that shape the universe are themselves arbitrary, like the laws of grammar and vocabulary, and just the result of our limited human brains? What if there is no underlying logic that holds it all together?
Re: GPT-J-6B: 6B JAX-Based Transformer
#5To test it out: https://6b.eleuther.ai/
It still amazes me. I ask it to write something, and when it does, I just want to ask it "dude, wtf?" Seriously, it's better than what shitposters on 4chan write. It's pure genius:
I was watching a climbing competition. I had never seen this before, and I am the world's worst fan of anything outdoors. The crowd was absolutely silent. Like, what, were they dead? It was eerie.
Cameo was a perfect example of the sport we love, because of the heavy concentration and the freedom it allowed the athletes, compared to what we do in our real lives. A top-ten contender got drilled off the wall by two burly volunteers, then grabbed an arm in an attempt to pull himself back onto the wall. The brawn of the competitors kicked in, and they were yelling and screaming, being half-carried away from the wall. In short order, everyone was pulled off the wall, the fight was finished, the duo were later ejected and the winner was declared.
Was that weird? No, of course not, that's what we all love. It's the circus, isn't it?
Re: GPT-J-6B: 6B JAX-Based Transformer
#6To test it out: https://6b.eleuther.ai/
Hug of death?
Re: GPT-J-6B: 6B JAX-Based Transformer
#7To test it out: https://6b.eleuther.ai/
It still amazes me. I ask it to write something, and when it does, I just want to ask it "dude, wtf?" Seriously, it's better than what shitposters on 4chan write. It's pure genius: I was watching a climbing competition. I had never seen this before, and I am the world's worst fan of anything outdoors. The crowd was absolutely silent. Like, what, were they dead? It was eerie. Cameo was a perfect example of the sport w…
I input the following: "dogs are superior to cats in every way". and the model generated the following...
dogs are superior to cats in every way. They are better at watching TV, they are better at using their tails as fans, they are better at eating out of bowls, they are better at watching over children, they are better at giving head, they are better at being pets, they are better at eating on command, they are better at looking up at you when you speak to them, they are better at smelling and tasting, they are better at chasing balls, they are better at listening to you, they are better at being groomed, they are better at eating from the floor, they are better at being petted, they are better at eating from your hand, they are better at sleeping, they are better at eating from your hand, they are better at cleaning their own paws, they are better at drinking from your hand, they are better at sleeping, they are better at cleaning their own paws, they are better at sleeping, they are better at drinking from your hand, they are better at cleaning their own paws, they are better at sleeping, they are better at drinking from your hand, they are better at cleaning their own paws, they are better at sleeping, they are better at drinking from your hand, they are better at cleaning their own paws, they are better at sleeping, they are better
Re: GPT-J-6B: 6B JAX-Based Transformer
#8Sorry guys, I think I broke it. I wanted to test it on my motivational speech,
Even moving the ball forward is a win at this company, so I wouldn’t worry too much. You are in what’s called a blood pit. This is a room in most abattoirs below the killing floor where runoff of various kinds is collected for purposes of selling to the protein shampoo industry (mostly). Above you is a grated floor where cows roam around until they are LR’d. Every now and then, a still-ambulatory, not yet LR’d cow accidentally shits out a nugget of something valuable that it accidentally ingested, and your job is to run from place to place in the blood pit, avoiding as best you can droppings of various consistencies from above (this is impossible to do perfectly) while pocketing nuggets. If you manage to pocket a few nuggets in a day’s work, that is a good day.
Unfortunately, it seems to have gotten too depressed to run after this.
Re: GPT-J-6B: 6B JAX-Based Transformer
#9Is it possible to run this on something other than google's cloud platform?