Live data from Hacker News

AlphaWrite: AI that improves at writing by evolving its own stories

tobysimonds.com

21–30 of 162 posts

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#22

This feels like a lot of fluff, without some solid examples of the results - the one example of generated prose that they do provide is pretty unimpressive, it reads like… well, like an LLM wrote it.

Indeed. Also the whole thing is just "apply an Evolutionary Algorithm to stories." The only interesting question is whether the LLM that decides the story's fitness rating (which they call Elo, despite seeming to have nothing to do with the actual Elo ranking system) can mimic a human's rating. Given the brief example, it's not clear that it can, since it seems no better.

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#23
post #5

If there is something that I would like AI to never touch, it's that. Please stop making the world worse.

More capable AI systems make the world better. If you don't like AI written material on principle, you can simply choose not to read it. Follow human writers who don't use AI.

> More capable AI systems make the world better.

Support that.

Now support it while including direct costs and externalities.

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#24

Those examples seem quite unrelated to one another. The first reads as admitting intentional fraud and deceit, the second reads like dealing with imposter syndrome. I'd love to know the prompt. Also, not sure how you can judge a style to be clearly better than another. The workflow of generating a bunch of stories in the style of different authors and then voting on a favorite just seems like picking a favorite autho…

> Those examples seem quite unrelated to one another. The first reads as admitting intentional fraud and deceit, the second reads like dealing with imposter syndrome. I'd love to know the prompt.

Yeah. And to read the rest of each of the stories it generated...

Both paragraphs are simply short excerpts which involve no actual narrative, never mind the stuff that LLMs are typically weak at (maintaining consistency, intricate plotting and pacing, subtlety in world and character building) which in the context of stories are far more important to improve than its phrasing.

The fact that the "improvement" apparently eliminates a flaw in the first passage ("gentle vibrations that vibrated through my very being" is pretty clunky description unlikely to be written by a native human; both paragraphs are otherwise passable and equally mediocre writing) by implying apparently completely different (and frankly less interesting) character motivations makes me doubt that it's actually iteratively improving stories rather than just spitting out significant rewrites which incidentally eliminate glaring prose issues.

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#25
post #5

If there is something that I would like AI to never touch, it's that. Please stop making the world worse.

You cannot stop people from making the world worse or better. The best you can do is focus on your own life. In time many will say we are lucky to live in a world with so much content, where anything you want to see or read can be spun up in an instant, without labor. And though most will no longer make a living doing some of these content creation activities by hand and brain, you can still rejoice knowing that thos…

Clearly you've never made a list of openai data centre locations before

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#26

Earlier quoted context omitted.

More capable AI systems make the world better. If you don't like AI written material on principle, you can simply choose not to read it. Follow human writers who don't use AI.

> More capable AI systems make the world better. Support that. Now support it while including direct costs and externalities.

If the cost and externality is that people are upset about it, I honestly don't care.

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#27
post #4

Note: Not associated with Google Deepmind (AlphaFold, AlphaGo, AlphaEvolve, etc.)

Though they obviously want to be to the point of infringing. It's the modern AI legal bubble so they'll never have to deal with the legal consequences.

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#28

I'm struggling a bit to understand the difference between the reported results in the blog post and the examples in the Github. The blog states: > "Alpha Writing demonstrates substantial improvements in story quality when evaluated through pairwise human preferences. Testing with Llama 3.1 8B revealed: 72% preference rate over initial story generations (95 % CI 63 % – 79 %) 62% preference rate over sequential-prompti…

Just to clarify slight misunderstanding the variants without parent ID aren't from the initial batch it just didn't carry over to the next batch. You can see "897ccd25-4776-4077-a9e6-0da34abb32a4" emerges from batch 5. Apologies probably should make this clearer. Appreciate feedback on blog post!

Re: AlphaWrite: AI that improves at writing by evolving its own stories

#29
post #5

If there is something that I would like AI to never touch, it's that. Please stop making the world worse.

More capable AI systems make the world better. If you don't like AI written material on principle, you can simply choose not to read it. Follow human writers who don't use AI.

That’s precisely the problem, though. The internet is already rapidly filling with AI-generated slop, and it takes a non-trivial amount of human brain power to determine whether the how-to article you’re reading is actually a reliable source or whether it was churned out to generate ad revenue.

The infinite number of monkeys with typewriters are generating something that sounds enough like Shakespeare that it’s making it harder to find the real thing.

Post reply on HN