In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipp…
LLM Inevitabilism
81–90 of 1001 posts
Re: LLM Inevitabilism
#82In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipp…
We kind of knew it for the internet and we basically figured it out early (even if we knew it was going to take a long time to happen due to generational inertia - see the death of newspapers).
For LLMs it looks a lot like deindustrialization. Aka pain and suffering for a lot of people.
Re: LLM Inevitabilism
#83In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipp…
Come back in a week and update us on how long you've spent debugging all the ways that the code was broken that you didn't notice in those 15 minutes.
Usually I don't nitpick spelling, but "mimnutes" and "stylisitic" are somewhat ironic here - small correct-looking errors get glossed over by human quality-checkers, but can lead to genuine issues when parsed as code. A key difference between your two examples is that the failure-cases of an HTML download are visible and treated-as-such, not presented as successes; you don't have to babysit the machine to make sure it's doing the right thing.
EDIT: plus, everything that sibling comments pointed out; that, even if AI tools _do_ work perfectly (they don't, and never will), they'll still do harm when "working-as-intended" - to critical thinking, to trust in truth and reporting, to artistic creation, to consolidation of wealth and capital.
Re: LLM Inevitabilism
#84Re: LLM Inevitabilism
#85Re: LLM Inevitabilism
#86Earlier quoted context omitted.
Ironically, this is exactly the technique for arguing that the blog mentions. Remember the revolutionary, seemingly inevitable tech that was poised to rewrite how humans thought about transportation? The incredible amounts of hype, the secretive meetings disclosing the device, etc.? That turned out to be the self-balancing scooter known as a Segway?
I think about the Segway a lot. It's a good example. Man, what a wild time. Everyone was so excited and it was held in mystery for so long. People had tried it in secret and raved about it on television. Then... they showed it... and... well... I got to try one once. It was very underwhelming...
LLMs have hundreds of millions of users. I just can't stress how insane this was. This wasn't built on the back of Facebook or Instagram's distribution like Threads. The internet consumer has never so readily embraced something so fast.
Calling LLMs "hype" is an example of cope, judging facts based on what is hoped to be true even in the face of overwhelming evidence or even self-evident imminence to the contrary.
I know people calling "hype" are motivated by something. Maybe it is a desire to contain the inevitable harm of any huge rollout or to slow down the disruption. Maybe it's simply the egotistical instinct to be contrarian and harvest karma while we can still feign to be debating shadows on the wall. I just want to be up front. It's not hype. Few people calling "hype" can believe that this is hype and anyone who does believes it simply isn't credible. That won't stop people from jockeying to protect their interests, hoping that some intersubjective truth we manufacture together will work in their favor, but my lord is the "hype" bandwagon being dishonest these days.
Re: LLM Inevitabilism
#87In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipp…
the issue isn't the capabilities of AI. It's how it will be used maliciously and change our society irrevocably. Not from saving developers hours of work. But from making truth even more subjective and at the whims of the powerful. And from devaluing and stagnating art even further. And from sabotaging the critical thinking capabilities of our youths. All technology comes with tradeoffs. The internet you describe als…
I also worked with a fellow manager who used to tell the engineers they were wrong because ChatGPT said so. That one was actually entertaining to watch. The coming humbling of that manager was so satisfying.
People put a lot of stake in what it says, not realizing it isn’t always right.
Re: LLM Inevitabilism
#88Earlier quoted context omitted.
I’ve tried to use AI for “real work” a handful of times and have mostly come away disappointed, unimpressed, or annoyed that I wasted my time. Given the absolutely insane hard resource requirements for these systems that are kind of useful, sometimes, in very limited contexts, I don’t believe its adoption is inevitable. Maybe one of the reasons for that is that I work in the energy industry and broadly in climate tec…
That's how people probably felt about the first cars, the first laptops, the first . People like you grumbled when their early car broke down in the middle of a dirt road in the boondocks and they had to eat grass and shoot rabbits until the next help arrived. "My horse wouldn't have broken down", they said. Technologies mature over time.
Re: LLM Inevitabilism
#89There may be an "LLM Winter" as people discover that LLMs can't be trusted to do anything. Look for frantic efforts by companies to offload responsibility for LLM mistakes onto consumers. We've got to have something that has solid "I don't know" and "I don't know how to do this" outputs. We're starting to see reports of LLM usage having negative value for programmers, even though they think it's helping. Too much eff…
It's so depressing to watch so many smart people spend their considerable talents on the generation of utter garbage and the erosion of the social fabric of society.
Re: LLM Inevitabilism
#90In the 90s a friend told me about the internet. And that he knows someone who is in a university and has access to it and can show us. An hour later, we were sitting in front of a computer in that university and watched his friend surfing the web. Clicking on links, receiving pages of text. Faster than one could read. In a nice layout. Even with images. And links to other pages. We were shocked. No printing, no shipp…
> Hours of time saved Come back in a week and update us on how long you've spent debugging all the ways that the code was broken that you didn't notice in those 15 minutes. Usually I don't nitpick spelling, but "mimnutes" and "stylisitic" are somewhat ironic here - small correct-looking errors get glossed over by human quality-checkers, but can lead to genuine issues when parsed as code. A key difference between your…
This so much - can't believe how much of these "I am not even reading the LLM code anymore it is that good" comments I am reading. Either you are all shit programmers or your "You are an expert senior software developer" prompts are hitting the LLM harder. Because I'm here LLMing as much as the next guy, hoping it will take the work away - but as soon as I start being lazy, jumping over the code and letting it take the wheel it starts falling apart and I start getting bug reports. And the worst part is - it's the code "I wrote" (according to git blame), but I'm reading it for the first time as well and reading it with attention to detail reveals its shit.
So not sure what models you guys are getting served - especially the OpenAI stuff for coding, but I'm just not getting there. What is the expert prompt sauce I am missing here ?