81–90 of 149 posts
Dude's an artist. He should do what his artistic intuition tells him to. I'm a software developer. I'll follow my own experience. It'll all work out.
It’s likely it won’t all work out.
> It would be foolish to deny the effectiveness of image recognizers based on generalized adversarial networks (GANs), the key neural network technology underlying LLMs I could be misreading this, but I hope the author doesn't think GANs are used in LLMs. They are cool, though.
[flagged]
Earlier quoted context omitted.
> But he’s made the error of trying to come at it from a technical perspective Huh? That quote appears to be the entirety of the "technical perspective" of the post and is an aside from his larger points that you have blessed as "fine". Literally nothing in the rest of the post relies on that incorrect statement. Let me quibble with what is discredited here, given the entirety of your point is built upon an error.
Here's another technical point: > They're word-association mechanisms with no embodiment and no way to associate the text vectors they manipulate with real-world phenomena. This is wrong too. RLVR grounds foundational models in reality.
> It would be foolish to deny the effectiveness of image recognizers based on generalized adversarial networks (GANs), the key neural network technology underlying LLMs I could be misreading this, but I hope the author doesn't think GANs are used in LLMs. They are cool, though.
It’s unfortunate - he’s an author, it would have been fine to stick with an authors perspective that LLMs can’t write (which is true), as well as the copyright stuff (which I don’t agree with but he certainly has standing to give an opinion on). But he’s made the error of trying to come at it from a technical perspective, when he clearly knows nothing about that side of things, which discredits the rest.
Earlier quoted context omitted.
It’s likely it won’t all work out.
Extremely likely. Humanity won't work out. Time is running out and we still kill each other over money and religions.
If you haven’t read The Collapse of Complex Societies by Joseph Tainter it’s worth a read. It’s not a conspiratorial or even outright pessimistic theory.
Earlier quoted context omitted.
Transformers are an architecture and GANs are a training method for the architecture. There are GAN Transformers.
Examples for us less educated folk?
In general probably not much of a stretch to get rid of convolutions or recurrence by replacing with attention and see if it works hence the title of the original transformers paper.
Earlier quoted context omitted.
It’s unfortunate - he’s an author, it would have been fine to stick with an authors perspective that LLMs can’t write (which is true), as well as the copyright stuff (which I don’t agree with but he certainly has standing to give an opinion on). But he’s made the error of trying to come at it from a technical perspective, when he clearly knows nothing about that side of things, which discredits the rest.
How does a tiny error, in an aside and unrelated to the greater point, made at near the end discredit the rest of it?
Earlier quoted context omitted.
I think it is true that people who obviously dislike AI for ideological reasons often lead with ecological concerns or doubt about the capabilities, leading to an unproductive discussion.
Have you considered engaging on those ecological concerns? There is quite a lot to dig into and can be pretty interesting. For example, try to project how much electricity will be needed to power all the datacenters in construction, then compare that to the existing grid and infra, then figure out the cooling capacity. If done well you will see that we have a pretty massive resource problem here
Earlier quoted context omitted.
Extremely likely. Humanity won't work out. Time is running out and we still kill each other over money and religions.
I’m more optimistic about humanity but I doubt the west will work out in its current trajectory. If you haven’t read The Collapse of Complex Societies by Joseph Tainter it’s worth a read. It’s not a conspiratorial or even outright pessimistic theory.
You wrote "the west", what system will (in theory) work out? And how much does it value the individual?
I know capitalism for example, can in theory, never succeed as its base premise is built on endless growth (which simply wont work out with finite resources). It's a short term system that we need to improve on. All the other systems we had, like feudalism, I'd rather die than live in... Personally I'd highly prefer socialism, but that also wont work out as too many humans highly reject its concept and its also not safe from corruption.