Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

HyperAgents: Self-referential self-improving agents

github.com

Post reply on HN
Print view View original

81–90 of 117 posts

Re: HyperAgents: Self-referential self-improving agents

#81

Post by galaxyLogic »

fmbb wrote: post #59
kordlessagain wrote: post #58

The loop on this is basically tweak your prompt until you score better on a contrived test.

Yeah if it was truly capable of self-improving, why did it not take over the world yet? Gemini itself says AGI will be here in 2029, with human level intelligence and self-improvement capabilities. But then it will take until 2045 before the singularity. I don’t understand what they are going to do in all those years.

I think Singularity is hype. What does it mean? Machines do something we can not understand? So talking about Singularity is really talking about something we can not talk about because we don't undertand what we are talking about?

Wittgenstein said "From what we can not speak of, we must be silent about". That sounds like a tautology but I think there is a deeper meaning behind it.

It means simply that once you start talking about what we can not talk about, you are already talking about that and therefore it is NOT something you can NOT talk about. Clearly we can talk about it because we are already talking about it. And therefore it is not something that can not be talked about. That is a paradox, a bit like Godel's, but something that doesn't contradict itself.

Re: HyperAgents: Self-referential self-improving agents

#83

Post by LuisvelAI »

lukebuehler wrote: post #19
NitpickLawyer wrote: post #9

The paper is here - https://arxiv.org/pdf/2603.19461 This, IMO is the biggest insight into where we're at and where we're going: > Because both evaluation and self-modification are coding tasks, gains in coding ability can translate into gains in self-improvement ability. There's a thing that I've noticed early into LLMs: once they unlock one capability, you can use that capability to compose stuff and improve on oth…

Agree. It's code all the way down. The key is to give agents a substrate where they can code up new capabilities and then compose them meaningfully and safely. Larger composition, though, starts to run into typical software design problems, like dependency graphs, shared state, how to upgrade, etc. I've been working on this front for over two years now too: https://github.com/smartcomputer-ai/agent-os/

[flagged]

Re: HyperAgents: Self-referential self-improving agents

#84

Post by [deleted] »

binarymax wrote: post #13
NitpickLawyer wrote: post #9

The paper is here - https://arxiv.org/pdf/2603.19461 This, IMO is the biggest insight into where we're at and where we're going: > Because both evaluation and self-modification are coding tasks, gains in coding ability can translate into gains in self-improvement ability. There's a thing that I've noticed early into LLMs: once they unlock one capability, you can use that capability to compose stuff and improve on oth…

I disagree that evaluation is always a coding task. Evaluation is scrutiny for the person who wants the thing. It’s subjective . So, unless you’re evaluating something purely objective, such as an algorithm, I don’t see how a self contained, self “improving “ agent accomplishes the subjectivity constraint - as by design you are leaving out the subject.

[deleted]

Re: HyperAgents: Self-referential self-improving agents

#85

Post by Drakim »

fmbb wrote: post #59
kordlessagain wrote: post #58

The loop on this is basically tweak your prompt until you score better on a contrived test.

Yeah if it was truly capable of self-improving, why did it not take over the world yet? Gemini itself says AGI will be here in 2029, with human level intelligence and self-improvement capabilities. But then it will take until 2045 before the singularity. I don’t understand what they are going to do in all those years.

I am capable of self-improving yet I haven't taken over the world yet.

Re: HyperAgents: Self-referential self-improving agents

#86

Post by XorNot »

galaxyLogic wrote: post #81
fmbb wrote: post #59

Earlier quoted context omitted.

Yeah if it was truly capable of self-improving, why did it not take over the world yet? Gemini itself says AGI will be here in 2029, with human level intelligence and self-improvement capabilities. But then it will take until 2045 before the singularity. I don’t understand what they are going to do in all those years.

I think Singularity is hype. What does it mean? Machines do something we can not understand? So talking about Singularity is really talking about something we can not talk about because we don't undertand what we are talking about? Wittgenstein said "From what we can not speak of, we must be silent about". That sounds like a tautology but I think there is a deeper meaning behind it. It means simply that once you star…

You got it in the third sentence and then dismissed it for some reason?

That's exactly what the Singularity is: it's the transition point beyond which meaningful predictions aren't possible.

In a black hole it's the center where relativity breaks down.

In AI it's the point at which non-human intelligence no longer requires human intelligence for self improvement: after which predictions of the future become somewhat meaningless.

In the human lives experience, I would argue its like having your first child: you can know what's coming, study the theory, know everything to expect and youre still you on the other side...but you can't really know what will happen till you get there.

Re: HyperAgents: Self-referential self-improving agents

#88

Post by ACCount37 »

NitpickLawyer wrote: post #9

The paper is here - https://arxiv.org/pdf/2603.19461 This, IMO is the biggest insight into where we're at and where we're going: > Because both evaluation and self-modification are coding tasks, gains in coding ability can translate into gains in self-improvement ability. There's a thing that I've noticed early into LLMs: once they unlock one capability, you can use that capability to compose stuff and improve on oth…

Yep. Behavior composition. If you train an LLM to do A and to do B, separately, chances are, it'll be decent at A+B despite not being trained for the combination.

Re: HyperAgents: Self-referential self-improving agents

#89

Post by foltik »

Jerrrrrrrry wrote: post #46
whattheheckheck wrote: post #39

Earlier quoted context omitted.

So where does gravity come from?

A cool illusion, just another emergent property of our geometrical solution: higher dimensional aperiodic tilings of a 10^80 faceted complex polyhedra "walking" on another large aperioidic Penrose plane, that is getting smaller in a dimension we observe as "energy". Basically a dice with a bajillion sides is getting rolled along an increasingly slim poker table, house winning eventually. Time only goes one way, proto…

[dead]
Post reply on HN