[flagged]
2025: The Year in LLMs
591–600 of 643 posts
Re: 2025: The Year in LLMs
#592The difference between the performance of models between 2024 and 2025 has been so stark, that graph really shows it. There are still many people on these forums who seem to think AI’s produce terrible code unless ultra supervised, and I can’t help but suspect some of them tried it a little while ago and just don’t understand how different it is now compared to even quite recently.
I used Gemini Pro, Claude Pro yesterday a couple of dozen times and basically have been daily. I have a project to convert my multiplayer XNA game from C# to Javascript and to add networking to the game-play using LLMs. They are far worse at it now than they were a year ago. They actually implemented the requirements (Though inaccurately) to the best of their ability a year ago. Especially Gemini. Now they don't even…
"They are far worse at it now than they were a year ago."
This is the part they REALLY don't want you to say.
They can no longer train these models effectively and their performance is slipping. Late 2023 was the golden age.
Re: 2025: The Year in LLMs
#593Let's talk about the societal cost these models have had on us including their high energy cost and the proliferation of auto-generated slop media used to milk ad revenue, scam people, SEO farm, do propaganda or automate trolling. What about these big corporations collecting an astronomical amount of debt to hoard DRAM and NAND in a way that has crippled the PC market within weeks? And what are they going to do next,…
> Who gets to keep all the hardware I wonder?
Keep questions like this off of the propaganda thread.
Re: 2025: The Year in LLMs
#594Nothing about the severe impact on the environment, and the hand waviness about water usage hurt to read. The referenced post was missing every single point about the issue by making it global instead of local. And as if data center buildouts are properly planned and dimensioned for existing infrastructure… Add to this that all the hardware is already old and the amount of waste we’re producing right now is mind bogg…
"Nothing about the severe impact on the environment" I literally said: "AI data centers continue to burn vast amounts of energy and the arms race to build them continues to accelerate in a way that feels unsustainable." AND I linked to my coverage from last year, which is still true today (hence why I felt no need to update it): https://simonwillison.net/2024/Dec/31/llms-in-2024/#the-envi...
Do you think anything should be done about this environmental impact?
Or should we just keep chugging along as though there is no problem at all?
Re: 2025: The Year in LLMs
#595Earlier quoted context omitted.
2022/2023: "Next year software engineering is dead" 2024: "Now this time for real, software engineering is dead in 6 months, AI CEO said so" 2025: "I know a guy who knows a guy who built a startup with an LLM in 3 hours, software engineering is dead next year!" What will be the cope for you this year?
I went from using ChatGPT 3.5 for functions and occasional scripts… … to one of the models in Jan 2024 being able to repeatedly add features to the same single-page web app without corrupting its own work or hallucinating the APIs it had itself previously generated… … to last month using a gifted free week of Claude Code to finish one project and then also have enough tokens left over to start another fresh project w…
So you did some basic web development and built a "not well engineered" greenfield app that you didn't ship, and from that your conclusion is that "writing code is dead"?
Re: 2025: The Year in LLMs
#596I hope 2026 will be the year when software engineers and recruiters will stop the obsession with leetcode and all other forms of competitive programming bullshit
Thanks to Klaude Kode it'll be at least another 20 years of this.
If you don't make software developers prove their literacy you will get burned.
Re: 2025: The Year in LLMs
#597You’re absolutely right! You astutely observed that 2025 was a year with many LLMs and this was a selection of waypoints, summarized in a helpful timeline. That’s what most non-tech-person’s year in LLMs looked like. Hopefully 2026 will be the year where companies realize that implementing intrusive chatbots can’t make better ::waving hands:: ya know… UX or whatever. For some reason, they think its helpful to distrac…
As much as I side with you on this one, I really don't think this submission is the right place to rant about it.
this thread is for pro-LLM propaganda only.
do not acknowledge that everyone in the world thinks this shit is a complete and total garbage fire
Re: 2025: The Year in LLMs
#598Earlier quoted context omitted.
There are quite a few studies to refute this highly ignorant comment. I'd suggest some reading [0]. From the abstract: "Is thought possible without language? Individuals with global aphasia, who have almost no ability to understand or produce language, provide a powerful opportunity to find out. Astonishingly, despite their near-total loss of language, these individuals are nonetheless able to add and subtract, solve…
Yeah, you can prove pretty much anything with a pubmed link. Do dead salmon "think?" fMRI says maybe! https://pmc.ncbi.nlm.nih.gov/articles/PMC2799957/ The resources that the brain is using to think -- whatever resources those are -- are language-based. Otherwise there would be no way to communicate with the test subjects. "Language" doesn't just imply written and spoken text, as these researchers seem to assume.
There’s linguistic evidence that, while language influences thought, it does not determine thought - see the failure of the strong Sapir-Whorf hypothesis. This is one of the most widely studied and robust linguistic results - we actually know for a fact that language does not determine or define thought.
Re: 2025: The Year in LLMs
#599Earlier quoted context omitted.
"Nothing about the severe impact on the environment" I literally said: "AI data centers continue to burn vast amounts of energy and the arms race to build them continues to accelerate in a way that feels unsustainable." AND I linked to my coverage from last year, which is still true today (hence why I felt no need to update it): https://simonwillison.net/2024/Dec/31/llms-in-2024/#the-envi...
Do you think anything should be done about this environmental impact? Or should we just keep chugging along as though there is no problem at all?
I think we should continue to find ways to serve this stuff more efficiently - already a big focus of the AI labs because they like making money, and reduced energy bills = more profitable inference.
I also think we should use tax policy to provide financial incentives to reduce the environmental impact - tax breaks for renewables, tax hikes for fossil fuel powered data centers, that kind of thing.