OpenAI Releases Largest GPT-2 Text Generation Model • Hacker News Board

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#91

Post by krick » Wed, Nov 06, 2019, 12:53 AM UTC

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake?

Jain Kim is an experienced climber.

In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting the record for the fastest time to climb an 8,000 meter peak with a team from China and South Korea.

She made the first ascent of 8,832-meter K2 in China, the second highest mountain in the world, in 2009 and the third highest mountain in Europe. She also is the first female Korean to summit a world-class peak.

During her two years as a mountaineering professor at Sogang University in Korea, she established two new routes in the Yalu River area. The first of these routes is a 3,547-meter peak named K2 on Mount Long in China. Her second route is on the same mountain, called the Lomonosov Ridge, at 3,632 meters.

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#92

Post by endtime » Wed, Nov 06, 2019, 1:04 AM UTC

dragonwriter wrote: post #66

endtime wrote: post #21

Earlier quoted context omitted.

Anti-Foos already think that real primary Foo sources are nonsense (and they aren't the target audience anyway), and confirmation bias will take care of the pro-Foos.

If it's not moving opinion, it's not effective propaganda. Something that people will agree with only to the extent it restates what they already believe isn't working as propaganda.

Not sure I agree. Some propaganda probably just wants to rile up the base.

It's also possible to change which issues seem most salient/urgent/etc. without actually changing anyone's mind. E.g. Democrats typically care about police brutality, and the environment, but they probably thought more about the former a few years ago and the latter more in 2019, even though AFAIK the actual issues haven't changed much.

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#93

Post by bonoboTP » Wed, Nov 06, 2019, 1:07 AM UTC

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

> Can anybody who is not into climbing even tell this is all fake?

Hm, I'm pretty sure it's hard to climb five 8000 meter peaks in 24 hours :)

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#94

Post by vpzom » Wed, Nov 06, 2019, 1:10 AM UTC

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

Well, it gives two different heights and locations for a single mountain

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#95

Post by backpropaganda » Wed, Nov 06, 2019, 1:16 AM UTC

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

Given sibling comments, this seems relevant: https://www.lesswrong.com/posts/4AHXDwcGab5PhKhHT/humans-who...

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#96

Post by krick » Wed, Nov 06, 2019, 1:23 AM UTC

bonoboTP wrote: post #93

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

> Can anybody who is not into climbing even tell this is all fake? Hm, I'm pretty sure it's hard to climb five 8000 meter peaks in 24 hours :)

Yeah-yeah, and "Lomonosov Ridge" is a weird name for a peak in China (and you might even happen to know the Lomonosov Ridge is underwater). Please don't be distracted by details. Maybe the author meant 24 h per peak, maybe his typing is really spurious. Is it really obvious to somebody who doesn't know anything about climbing that this is not true? Come on.

What's really fascinating is how truth is mixed up with made up stuff. It's incredible, how much much real-world knowledge it has.

- Jain Kim is likely a female name.

- Jain Kim is likely a Korean.

- K2 is in China and it is the second highest mountain in the world.

- Mountaineering is somehow associated with climbing (and Jain Kim is not known for mountaineering, btw).

- 8,000 meters is 24,064 ft and this is a formidable height.

- climbing something in 24 h is a common pattern for a type of achievement.

And more.

No, I'm completely sure it would throw off plenty of people.

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#97

Post by cure » Wed, Nov 06, 2019, 1:27 AM UTC

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

> Can anybody who is not into climbing even tell this is all fake?

Yeah, there are zero 8,000 meter peaks in the Swiss Alps. The Mont Blanc is the tallest at 4,808 meters (https://en.wikipedia.org/wiki/List_of_mountains_of_the_Alps_...).

I'm not a climber :)

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#98

Post by krick » Wed, Nov 06, 2019, 1:31 AM UTC

vpzom wrote: post #94

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

Well, it gives two different heights and locations for a single mountain

Yeah, I consider it the most serious fuck up. Yet, I'm not sure I would be really troubled even by that one if I knew nothing about that and casually came across this piece. I mean, maybe K2 is a name for 2 different peaks (it sure sound generic!), maybe something else I don't understand. Who knows!

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#99

Post by k8si » Wed, Nov 06, 2019, 1:31 AM UTC

Omfg can we stop making these things bigger PLEASE

Like, who cares??

* What I mean is, text gen models are big enough. We need controllable text generation; like, so it can talk about a specific THING sensibly. Rather than spew statistically plausible nonsense.

Re: OpenAI Releases Largest GPT-2 Text Generation Model

#100

Post by krick » Wed, Nov 06, 2019, 1:35 AM UTC

cure wrote: post #97

krick wrote: post #91

Wow, some samples are frighteningly good. I was impressed by previous models and I don't know if I'm just lucky this time, but... wow. Can anybody who is not into climbing even tell this is all fake? Jain Kim is an experienced climber. In 2006, she became the first woman from Korea to climb all five 8,000 meters (24,064 ft) peaks in the Swiss alpine ski run Alps in 24 hours. In 2009, she made history again by setting…

> Can anybody who is not into climbing even tell this is all fake? Yeah, there are zero 8,000 meter peaks in the Swiss Alps. The Mont Blanc is the tallest at 4,808 meters ( https://en.wikipedia.org/wiki/List_of_mountains_of_the_Alps_... ). I'm not a climber :)

I just answered in a similar manner to a different comment, but still: do you understand that you are boasting how smart and well-educated you are compared to completely ignorant piece of machinery which is Neural Net? Come on people, what's up with you! Do you know how many adults don't have a slightest clue how much is 8K and where the tallest peaks are?