191–200 of 267 posts
Earlier quoted context omitted.
2026: $1,000/month 2027: $100/month 2028: $10/month
RAM: 2024: $315 2025: $780 2026: $1600
Jan. 2023: $1920
Jan. 2024: $1811
Jan. 2025: $1639
Jan. 2026: $2193
[1] https://bestvaluegpu.com/history/new-and-used-rtx-4090-price...
Earlier quoted context omitted.
The implied assumption that “writing correct code” used to be a limitation that has been solved since 2024 is… overstating current capabilities. The idea that “AI models” have acquired “agency” as of 2025 and are working on “self-improvement” in 2026 is closer to delusion than exaggeration.
We are either living in different worlds, or squabbling over different meanings of words. Models have absolutely acquired agency as of 2025. Developers are no longer copy-pasting code from ChatGPT into their text editor, they're working with agents like Claude Code and Codex that can edit code, run terminal commands, do web searches, manage their own context windows, sift through gigabytes of logs with datadog MCP, e…
What you call a model acquiring agency I call plain old software with productivity workflows designed by humans, with deliberate goals. We must separate “model” and an execution environment using a model. [Model] ≠ [A glorified shell script doing API calls in a control flow based on heuristics]. Agents are not AI, they are plain old software. The weights are the model, and that very much remains a static artifact (and pre-post training models haven’t improved much over the last few years).
What you call self improvement is a duck tape hack to imitate persistence and save on inference. Every time you do an API call, anything that needs to be processed is sent to the model. Narrowing that context down saves money. Finding clever ways to do that improves apparent performance and value. The cleverness is still human.
These are all useful innovations on top of LLMs, which remain models that generate text and symbols based on static weights, which in turn represent training data and the provider’s preferences.
I don't want agents that know a lot about me. From my experience, the "memory" feature in ChatGPT makes it worse - I don't want the agent to bring up whatever I discussed before in a new session; I want a "fresh context" every time. I don't want agents/chatbots to bring up what I did one week ago in a new session.
He proposes to take something like the Memory feature and make the agents all about that. Very personal agents that know all about you and extend you. I personally don't think I want that.
But maybe I am wrong! Gwern is talking about AI for a long time and seems to know what he talks about. The article on his webpage makes sense in a way.
LLM psychosis claims another victim... A reminder for anyone reading this: talk to people. Real humans[1]. They will remind you there's more to life than what ChatGPT can offer you. They might even remind you, for all their stupidity and flaws, what intelligence looks like as compared to a program that predicts tokens. Forums like these always get philosophical in high-minded discussions about intelligence, but there…
Earlier quoted context omitted.
They still can't. But very smart humans constructed ways to use the monkeys with typewriters (with a statistical advantage) to find correct answers to problems where they already knew how to verify the answer.
Which problems are not amenable to that approach?
LLM psychosis claims another victim... A reminder for anyone reading this: talk to people. Real humans[1]. They will remind you there's more to life than what ChatGPT can offer you. They might even remind you, for all their stupidity and flaws, what intelligence looks like as compared to a program that predicts tokens. Forums like these always get philosophical in high-minded discussions about intelligence, but there…
Earlier quoted context omitted.
> enabling those who believe themselves to be good is more important than reducing wanton suffering I'm genuinely not sure if you're referring to my comment or the one I responded to haha
i read your article you posted here. in that article you state that you support live and let live. most people who support live and let live either havent been raped by life yet, or have chosen to double down post-rape. the latter is respectable, still im not currently interested in a discussion involving the influence of such a perspective. out of good faith i highlight that i responded to: > ideally, we could find…
Earlier quoted context omitted.
2026: $1,000/month 2027: $100/month 2028: $10/month
Just because the hardware and inference costs may decrease in the future doesn't mean prices will. The AI vendor market is the furthest thing from a competitive industry where there are limited barriers to entry and new market entrants exert downward pressure on prices and profit margins. Every single company in this market is losing billions on this business, and the only way to make it back is to acquire paying cus…
[1]: https://openai.com/index/advancing-the-price-performance-fro...
It's hard to read Gwern's accompanying article without seeing this for what it is, which is a kind of mania. I'm sure he means well and is genuine in his aspirations, but what's outlined for GA is framing LLM's as quasi-gods, which they absolutely are not. I wish him the best, and look forward to being proven wrong.
LLM trained on you and fine-tuned on you. It does make sense in a way!
It is not what I want from LLMs, I think... but it might work.
Gwern obviously knows what he talks about. It doesn't seem like a Gas Town-like fever dream.
Earlier quoted context omitted.
Has an LLM ever intentionally made you laugh? Cry?
Have you? (I'm trolling, I'm not sure what you're asking or why)