> It would be foolish to deny the effectiveness of image recognizers based on generalized adversarial networks (GANs), the key neural network technology underlying LLMs I could be misreading this, but I hope the author doesn't think GANs are used in LLMs. They are cool, though.
He hallucinated. This is how you verify non AI nowadays. AI is so good that if you see an hallucination as obviously wrong like this one it’s a sign it’s written by a human.
On the non-use of AI in my writing process
71–80 of 149 posts
Re: On the non-use of AI in my writing process
#72Earlier quoted context omitted.
It’s unfortunate - he’s an author, it would have been fine to stick with an authors perspective that LLMs can’t write (which is true), as well as the copyright stuff (which I don’t agree with but he certainly has standing to give an opinion on). But he’s made the error of trying to come at it from a technical perspective, when he clearly knows nothing about that side of things, which discredits the rest.
> But he’s made the error of trying to come at it from a technical perspective Huh? That quote appears to be the entirety of the "technical perspective" of the post and is an aside from his larger points that you have blessed as "fine". Literally nothing in the rest of the post relies on that incorrect statement. Let me quibble with what is discredited here, given the entirety of your point is built upon an error.
> They're word-association mechanisms with no embodiment and no way to associate the text vectors they manipulate with real-world phenomena.
This is wrong too. RLVR grounds foundational models in reality.
Re: On the non-use of AI in my writing process
#73From the comments: > I will concede that using LLMs in software development is a different category from fiction, insofar as the languages and APIs are much smaller and more tightly constrained and in software you actively don't want long-range dependencies between elements (something you often do want in fiction, i.e. put a gun on the mantlepiece in part 1 of the book, pull the trigger in part 3).
It can definitely plan such things. Because agentic systems don't have to output a book all at once. The mainstream still lives 1-2 years in the past. Agents can plan out a narrative draft, write it out section by section, maybe out of order, then tweak it, plant clues if it wants to, then trigger it in another chapter file etc. Then read the whole thing, reconsider, etc. It can iterate. I'm not saying it will be gre…
I sure would. If you want a religious tone to it… It would be a signal suggesting that the human spirit(tm) had finally transcended.
If humans can someday build a machine that can truly carry a (trans)human mind, and let some future souls live unconstrained by all the quirks and limitations of our preexisting biology, exercising more control of their own lives - that’d be wonderful.
I obviously have no idea wherever language models can lead to such dream, of would be a dead end.
Re: On the non-use of AI in my writing process
#74Earlier quoted context omitted.
It's rare. It's mostly, "but it will never be able to do X" (when it can already do X), or it uses too much water (while having no idea or reference point to what amount is much), or other climate things, or non-progressive bias, or copyright (when training is fair use) etc. Just be upfront. 1) It threatens your livelihood that people can get the thing done faster and cheaper than what they used to pay you, 2) our re…
I think it is true that people who obviously dislike AI for ideological reasons often lead with ecological concerns or doubt about the capabilities, leading to an unproductive discussion.
Re: On the non-use of AI in my writing process
#75Crazy how forward thinking this guy was in 2005 vs today.
Crazy to assume that an individual of vision has so thoroughly dropped the plot simply because their position is at odds with tech industry orthodoxy. If anything that should be an indication to more closely examine your assumptions.
Re: On the non-use of AI in my writing process
#76While Stross is currently a neo-Luddite who doesn't believe in the Singularity, his book Accelerando is probably the best work of Singularitarian fiction ever written. It was written in the 2000s, starts in the 2010s, and covers the various decades of this century. I highly recommend it for anyone who wants to know how weird this century will be. It's also available for free online. [1] It's one of my favorite books…
He had already disappointed me in 2011 with this post https://www.antipope.org/charlie/blog-static/2011/06/reality...
Re: On the non-use of AI in my writing process
#77I wouldn't be too upset about that. They write better anyway.
Re: On the non-use of AI in my writing process
#78Crazy how forward thinking this guy was in 2005 vs today.
Re: On the non-use of AI in my writing process
#79Doesn't most of this also apply to a guy living in The Matrix?
Re: On the non-use of AI in my writing process
#80Crazy how forward thinking this guy was in 2005 vs today.