Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Reflections on AI at the End of 2025

antirez.com

Post reply on HN
Print view View original

31–40 of 383 posts

Re: Reflections on AI at the End of 2025

#31

Post by defrost »

dkdcio wrote: post #25
grodriguez100 wrote: post #10

Earlier quoted context omitted.

I would say yes, everyone should care about it. There is plenty of material on the topic. See for example https://ai-2027.com/ or https://www.lesswrong.com/posts/uMQ3cqWDPHhjtiesc/agi-ruin-a...

fear mongering science fiction, you may as well cite Dune or Terminator

There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947)

  Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life.

  No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Humans who resist the Prime Directive are taken away and lobotomized, so that they may live happily under the direction of the humanoids.
~ https://en.wikipedia.org/wiki/With_Folded_Hands_...

Re: Reflections on AI at the End of 2025

#32

Post by a_bonobo »

>* For years, despite functional evidence and scientific hints accumulating, certain AI researchers continued to claim LLMs were stochastic parrots: probabilistic machines that would: 1. NOT have any representation about the meaning of the prompt. 2. NOT have any representation about what they were going to say. In 2025 finally almost everybody stopped saying so.

Man, Antirez and I walk in very different circles! I still feel like LLMs fall over backwards once you give them an 'unusual' or 'rare' task that isn't likely to be presented in the training data.

Re: Reflections on AI at the End of 2025

#33

Post by jmfldn »

a_bonobo wrote: post #32

>* For years, despite functional evidence and scientific hints accumulating, certain AI researchers continued to claim LLMs were stochastic parrots: probabilistic machines that would: 1. NOT have any representation about the meaning of the prompt. 2. NOT have any representation about what they were going to say. In 2025 finally almost everybody stopped saying so. Man, Antirez and I walk in very different circles! I s…

"In 2025 finally almost everybody stopped saying so."

I haven't.

Re: Reflections on AI at the End of 2025

#34

Post by lemming »

danielfalbo wrote: post #2

> There are certain tasks, like improving a given program for speed, for instance, where in theory the model can continue to make progress with a very clear reward signal for a very long time. This makes me think: I wonder if Goodhart's law[1] may apply here. I wonder if, for instance, optimizing for speed may produce code that is faster but harder to understand and extend. Should we care or would it be ok for AI to…

I wonder if, for instance, optimizing for speed may produce code that is faster but harder to understand and extend.

This is generally true for code optimised by humans, at least for the sort of mechanical low level optimisations that LLMs are likely to be good at, as opposed to more conceptual optimisations like using better algorithms. So I suspect the same will be true for LLM-optimised code too.

Re: Reflections on AI at the End of 2025

#36

Post by rckt »

> Even if LLMs make mistakes, the ability of LLMs to deliver useful code and hints improved to the point most skeptics started to use LLMs anyway

Here we go again. Statements with the single source in the head of the speaker. And it’s also not true. The llms still produce bad/irrelevant code at such rate that you can spend more time prompting than doing things yourself.

I’m tired of this overestimation of llms.

Re: Reflections on AI at the End of 2025

#37

Post by XorNot »

defrost wrote: post #31
dkdcio wrote: post #25

Earlier quoted context omitted.

fear mongering science fiction, you may as well cite Dune or Terminator

There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947) Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life. No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Hu…

This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.

Re: Reflections on AI at the End of 2025

#38

Post by [deleted] »

XorNot wrote: post #37
defrost wrote: post #31

Earlier quoted context omitted.

There's arguably more dread and quiet constrained horror in With Folded Hands ... (1947) Despite the humanoids' benign appearance and mission, Underhill soon realizes that, in the name of their Prime Directive, the mechanicals have essentially taken over every aspect of human life. No humans may engage in any behavior that might endanger them, and every human action is carefully scrutinized. Suicide is prohibited. Hu…

This hardly disproves the point: no one is taking this topic seriously. They're just making up a hostile scenario from science fiction and declaring that's what'll happen.

[deleted]

Re: Reflections on AI at the End of 2025

#39

Post by matthewmacleod »

torlok wrote: post #12

This is a bunch of "I believe" and "I think" with no sources by a random internet person.

That is what a blog post is. Someone documenting what they think about a topic.

It's not the case that every form of writing has to be an academic research paper. Sometimes people just think things, and say them – and they may be wrong, or they may be right. And they sometime have some ideas that might change how you think about an issue as a result.

Re: Reflections on AI at the End of 2025

#40

Post by ctoth »

torlok wrote: post #12

This is a bunch of "I believe" and "I think" with no sources by a random internet person.

Ah, I see you have discovered blogs! They're a cool form of writing from like ~20 years ago which are still pretty great. Good thing they show up on this website, it'd be rather dull with only newspapers and journal articles doncha think?
Post reply on HN