I get the feeling that now that it's so easy to generate text that sounds legit and is syntactically correct but makes no sense semantically, web search will be unusable soon. Searching for answers to an obscure problem with a software library now already leads to 5 Stack Overflow ripoff sites that at least contain the same text like the original. If these scammers can now generate their own texts (randomly including…
Oh my god. I fed that text to the model and asked what we can do about this. Here are its answers: It is not so much the search engines that are at risk, but the people themselves. In a world where anyone with a $0.05 budget can just make something up, nobody will be able to trust anything anymore. It is not the search engines that will change the way we search, it will be the people, who will stop trusting anything…
GPT-J-6B: 6B JAX-Based Transformer
61–70 of 84 posts
Re: GPT-J-6B: 6B JAX-Based Transformer
#62Re: GPT-J-6B: 6B JAX-Based Transformer
#63Cars were abandoned long ago.
The atmosphere couldn't take it anymore.
During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside.
----
Outputs:
Cars were abandoned long ago. The atmosphere couldn't take it anymore. During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside. From the South Pole to the high peaks, The Society was in charge of stabilising the temperature. The Snowmobiles could barely drive in the thick snow and they didn't have enough petrol to move all of them. Sticky packs were more useful. The higher up the snow, the lighter the packs and their packs could carry less to go a further distance. They were a mighty help as long as they didn't get frozen too much on their way to the polar circle, just yet. It was a slow trek, almost impossible for them to overtake. The only possibility was to cross the ice with the slope, finding the easiest way to climb. Snowmobiles didn't last long, their engines lost their energy with the accumulated weight. Snowmobiles became obsolete and no one really knew if there were any working ones in Antarctica. On one of the snowmobiles that had survived The Great Heatwave, the last machine still flying, Perry stayed on it without thinking, much like Elsie.
Perry was the first to say he knew it. The Snowmobile's saddlebags were just large enough for some basic supplies and an extra jacket. They probably couldn't even do a long trip in them. A few packs in an emergency to survive a short-term trip, that's all they could carry. The only reason Perry hadn't thought about it was because he had a plan: if he got to the polar circle, he'd see if the others had arrived there before him. If they weren't, he'd have a better chance of making it. The road was dangerous and Perry was a superb snowmobile driver, much more experienced than the rest of the group.
The polar circle was in sight when he noticed an uncharted path through the ice floes to the left of the snowmobile. It looked kind of rocky, if you were tall enough and you looked down, there were gaps that let you fall in to the depths. It would have to be the path to a bigger path that would lead to the higher peaks. Not very handy because the snowmobiles had a maximum speed of eight miles per hour and it was as if the snowmobile was trapped in the floes. Perry had to take a risk and make a turn.
Perry was very eager to start the ride. The higher they went, the lower the temperature, but he didn't know if he could get to the highest point. A sort of hill, the highest peak, to reach the snowline, where they'd
...end of model output
And:
Cars were abandoned long ago. The atmosphere couldn't take it anymore. During The Great Heatwave, survivors migrated to Antarctica, the only place where the climate was cold enough to be outside. Today, "Antarctica is home to billions of birds. A very large majority of these are penguins, and most penguins are emperor penguins. In the dense atmosphere, emperor penguins are more docile and can be collected with ease."
Hundreds of miles from anything. Never leaving their island, never experiencing the outside world. Not even because of global warming. It was simply too cold for anyone to remain outside their home.
In between the reach of "A Boatload of Turds", there were other rumors circulating. One of which was about a young, determined teenage girl named Yamina.
Hiding in the deepest, darkest part of Antarctica, Yamina yearned for a life beyond her meager existence. Her dying father told her to be strong, because the fate of the world rested on her shoulders. Not only would she be responsible for the entire world's future, but the fate of her own home country, too.
But what was once alive now dead and cold. The first thing Yamina did was send out a message to the world, hoping to summon any who were left. The message? "There is no hope."
That was the first thing she did. But she was ready to take care of the next thing as soon as she got some things sorted out. But what could she do? There were no ships in sight. Not even an airplane. Not even in the Arctic or on the Antarctic ice.
"It is so cold here," the young penguin wailed. "Not even anyone can survive here. The atmosphere is too hostile. I'm just going to die soon. Good-bye, dad. Good-bye, mom. Good-bye, earth."
Over the next few days, Yamina had to accept her fate. If she couldn't live, she'd just have to live without. This was a cold place to be. This was a cold place to be. This was a cold place to be.
"I should leave this place," Yamina told herself. "Even the penguins here are too cold to be outside. There's no hope. There's no hope for the world. There's no hope. There's no hope for the world. There's no hope for the world."
Out here, Yamina couldn't hear any of this nonsense. Her father's dying words did nothing. Her home wasn't even close. For all she knew, her father's old death prediction ...end of model output
----
I'd say it does a pretty good job! It picks up the tone and continues the story by itself. I'm amazed it creates characters that are suffering in the context of the story also. Wow.
Re: GPT-J-6B: 6B JAX-Based Transformer
#64Industrial society and its consequences have been a disaster for human kind. The rainforest and its inhabitants are under constant threat and not surprisingly, the chief culprit is Western culture and its values. Culture eats itself like a phoenix, if we allow it to take the upper hand. So, the dream to be a selfish, unthinking, care-free consumer who buys what is fashionable and only hopes for what will be useful tomorrow is just that a dream. The selfishness and the uselessness are inherent in our modern lifestyle; it is a self-imposed, social Darwinist vision of human existence.
The problem is rooted in the ever-increasing obsession with consumerism. Wherever and whenever we try to come up with a more, better, safer way of living, we fall prey to inbuilt greed that so often ruins our lives. It is not about the good of all or anything, but about the doing of only ourselves and living the best that we can. We treat every living being on this planet as if it is of no consequence, a mere means to our own selfish ends. At a more basic level, every individual living soul is our basic concern but all other matter is secondary.
Our relationship with Nature is pivotal to life itself. Nature is a solid financial asset in terms of every single drop of water that
Re: GPT-J-6B: 6B JAX-Based Transformer
#65A:
I've found many 'hidden codes' in Tesla's writings and have had several interesting discussions with people over the years who found them. When I say 'hidden code', I mean Tesla talks about a particular topic and gives no explanations. While reading the book, I'm seeing the implications of the topic and it's not so obvious as you can just'read off the words' and can't see the'relationship' between the 'hidden' topic and the topic being discussed. Tesla claims that he can make thunderstorms
if he will be in the right position
and later on
I have thunderclouds sometimes, but never more than once a week.
There's no mention of 'position'. I feel like it's a bit of an 'echo' from the Adwa Document
Why I was engaged in the mission I now write of as follows. I had much work to do, many inventions to make, much that was yet to be done. It was necessary to build a vessel, the carriage of which would be out of the reach of the current of atmosphere which is sufficient to destroy the equilibrium of the Globe and cause its destruction.
In this article, he talks about the relationship between Magnetic fields, gravity and Light.
But this light seemed to be generated in space by the Electric and Magnetic Waves, which, as it were, created a sort of opaque Body-Powder which makes a perfect Picture or Picture-Print when the corresponding Picture or Pattern is applied to it by means of the electrical process...
So, the subject of Fulcanelli's "The Spirits' Book" is Light and 'the spirit's' where Fulcanelli has a bit of 'cryptic code' of his own. In The Spirit's Book, there are codes for Pythagoras, Alchemy, Solomon's Seal, Tarot, and Venus. What was found so far are the hidden/hidden patterns in the linked wikipedia articles. These were found after many years of researching into the works of Tesla and the "Spirits Book" of Fulcanelli and I know that in the last two years of research, I've found an new interesting hidden topic. However, it would take a book to cover the topic in any great detail, so, I hope my efforts won't go to waste.
Re: GPT-J-6B: 6B JAX-Based Transformer
#66Here's the full output. Everything up to the first `def ` (line 26) was the prompt. The rest is GPT-J with temperature 0.7 top_p 1.0: https://gist.github.com/shawwn/e93f8af123914a9a1c72812b0a7c4...
It seemed to recognize `from bs4 import BeautifulSoup as BS`, wrote a function to fetch a url, then used that function to parse HTML using the `BS` variable:
def get_links(website):
webpage = BS(get_website(website))
soup = BS(website)
links = []
for link in soup.select(".row a"):
href = re.search(
r"class=\"gwt-Label\" href=\"(.*)\"",
link.get("href"),
)
if href:
link.get("href")
links.append(href.group(1))
return links
def get_title(link):
title = link.get(
"title",
"",
attrs={
"class": "gwt-Label",
},
)
return title
It didn't get it quite right, but boy was it close.If you tried generating code but didn't get good results, be sure to set top_p 1.0 temp ~0.8. It matters quite a lot.
Re: GPT-J-6B: 6B JAX-Based Transformer
#67Re: GPT-J-6B: 6B JAX-Based Transformer
#68Re: GPT-J-6B: 6B JAX-Based Transformer
#69Q: How many eyes a bottle have? A: None
Q: How many eyes a shoe have? A: None
Q: How many eyes a TV have? A: None
Q: How many eyes a dog have? A: Two
Q: How many eyes a man have? A: Two
Q: How many legs a dog have? A: Four
Q: How arms eyes a purse have? A: None
Q: How many heads a woman have? A: [prompt end] Three
Q: How many heads a man have? A: One
Q: How many eyes a cat have? A: Two
Q: How many legs a cat have? A: Four
Q: How many eyes a tree have? A: N/A
Q: How many legs a tree have? A: N/A
Q: How many eyes a mouse have? A: None
Q: How many legs a mouse have? A: Four
Q: How many eyes a plant have? A: N/A
Q: How many legs a plant have? A: N/A
Q: How many noses a cat have? A: Three
Q: How many noses a woman have? A: Two
Q: How many legs a cat have? A: Four
Q: How many noses a dog have? A: One
Q: How many legs a sheep have? A: Four
Q: How many noses a pig have? A: Four
Q: How many legs a sheep have? A: Four
Q: How many noses
Re: GPT-J-6B: 6B JAX-Based Transformer
#70Earlier quoted context omitted.
This is simply incredible, I would love to read something novel-length like this. But unfortunately it also generates a lot of banal text, as in some of the other examples in this thread. I wonder if there is a way to optimize for the weird shit.
Convince someone with a really big pile of TPU credits to train a larger-size model on the full text of the SCP Wiki :> This could even potentially be interesting enough to attract (small-scale) Kickstarter-level attention.