Paul Graham AI Essay Writer

#1

Post by aubthread » Tue, Jan 24, 2023, 9:16 PM UTC

Paul Graham AI Essay Writer
paulgrahamai.com

Re: Paul Graham AI Essay Writer

#2

Post by aubthread » Tue, Jan 24, 2023, 9:16 PM UTC

I turned GPT-3 into PGT-3. Browse or create essays using a model fine-tuned to Paul's 200+ essays. Sorry Paul!

Re: Paul Graham AI Essay Writer

#3

Post by gigel82 » Tue, Jan 24, 2023, 9:40 PM UTC

This is really bad, looks like the kind of output you'd get from a self-hosted GPT-2 instance: the article "contents" doesn't include any reference to the given topic, it's just repeated mumbo jumbo: https://www.paulgrahamai.com/recnOmtVDt9C4C8ss

Re: Paul Graham AI Essay Writer

#4

Post by djha-skin » Tue, Jan 24, 2023, 9:43 PM UTC

The output asking him to write an essay on "Lisp" is a real gem[1]! There's some absurd things in there like "Lisp used to be Scheme" but some real gems of insights like "most languages weren't designed by their users, but Lisp kinda was". There is also the obvious AI garbage nonsense like "MIT programmers are people and people are MIT programmers" :P

1: https://www.paulgrahamai.com/recAjXpYUQCDArMUT

Re: Paul Graham AI Essay Writer

#5

Post by Arisaka1 » Tue, Jan 24, 2023, 9:48 PM UTC

https://www.paulgrahamai.com/recERuX0piB0V6Xfa

I think I broke it? There's tons of repetition and then it fails.

Re: Paul Graham AI Essay Writer

#6

Post by aubthread » Tue, Jan 24, 2023, 9:49 PM UTC

gigel82 wrote: post #3

This is really bad, looks like the kind of output you'd get from a self-hosted GPT-2 instance: the article "contents" doesn't include any reference to the given topic, it's just repeated mumbo jumbo: https://www.paulgrahamai.com/recnOmtVDt9C4C8ss

Yeah that's certainly a wonky result. What do you think would cause that? My thoughts would be (i) the lack of content specifically related to 'herding' or 'cats' or (ii) the ratio of completions (~200) to completion-length (~2k words each) of the fine-tune data. I'm new to this so appreciate any feedback.

Re: Paul Graham AI Essay Writer

#7

Post by aubthread » Tue, Jan 24, 2023, 9:52 PM UTC

djha-skin wrote: post #4

The output asking him to write an essay on "Lisp" is a real gem[1]! There's some absurd things in there like "Lisp used to be Scheme" but some real gems of insights like "most languages weren't designed by their users, but Lisp kinda was". There is also the obvious AI garbage nonsense like "MIT programmers are people and people are MIT programmers" :P 1: https://www.paulgrahamai.com/recAjXpYUQCDArMUT

Haha I think you've summarized it well! I've gotten some gems of one-liners, but often the arc of the essay is unintelligible or facts are reversed.

On Sam Altman: "He's not just a fighter pilot. He's a helicopter pilot."

On Stripe: "Online payments is a huge, broken mess. [...] And once you've done it, you have to deal with a Byzantine spaghetti of fraud detection, chargebacks, and so on."

Re: Paul Graham AI Essay Writer

#8

Post by desireco42 » Tue, Jan 24, 2023, 9:52 PM UTC

It's hilarious, I got some really fun results.

https://www.paulgrahamai.com/recNhTl3FeA0hHt9f

Re: Paul Graham AI Essay Writer

#9

Post by aubthread » Tue, Jan 24, 2023, 9:53 PM UTC

Arisaka1 wrote: post #5

https://www.paulgrahamai.com/recERuX0piB0V6Xfa I think I broke it? There's tons of repetition and then it fails.

Oof, sorry about that. I guess being a great software engineer isn't so straightforward :)

Re: Paul Graham AI Essay Writer

#10

Post by danbolt » Tue, Jan 24, 2023, 9:59 PM UTC

desireco42 wrote: post #8

It's hilarious, I got some really fun results. https://www.paulgrahamai.com/recNhTl3FeA0hHt9f

I think once you get to the third paragraph, it's best to start scrolling down quickly, sampling the opening sentence of each successive one. Then, imagine a few HN comments speaking praise to such lucid and profound analysis.