Live data from Hacker News

A deep dive into self-improving AI and the Darwin-Gödel Machine

richardcsuwandi.github.io

21–30 of 103 posts

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#21
post #15

“Gaming the system” means your metric is bad. In Darwinian evolution there is no distinction between gaming the system and developing adaptive traits.

There is no "gaming the system" in Darwinian evolution. You reproduce or you don't. There's no way to fail reproduction and still perpetuate your genetics.

Consider the plumpest cows whose carcass has been noticed, then subsequently cloned.

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#22

We realize test driven development doesn't work, right? Any scientist worth... any salt will tell you that fitting data is the easy part. In fact, there's a very famous conversation between Enrico Fermi and Freeman Dyson talking about just this. It's something we've known about in physics for centuries Edit: Guys, I'm not saying "no tests", the "Driven Development" part is important. I'm talking about this[0]. | Test…

> We realize test driven development doesn't work, right?

What do you mean with this? I'm a software engineer, and I use TDD quite often. Very often I write tests after coding features. But I see a huge value coming from tests.

Do you mean that they can't guarantee bug free code? I believe everyone knows that. Like washing your hands: it won't work, in the sense you will still get sick. But less. So I'd say it does work.

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#23

We realize test driven development doesn't work, right? Any scientist worth... any salt will tell you that fitting data is the easy part. In fact, there's a very famous conversation between Enrico Fermi and Freeman Dyson talking about just this. It's something we've known about in physics for centuries Edit: Guys, I'm not saying "no tests", the "Driven Development" part is important. I'm talking about this[0]. | Test…

We realize that test driven development has a refactoring step, right? Science can happen there if the practitioner is smart enough.

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#25

I don't want to be the European in the room, yet I am wondering if you can prove the AI Act conformance of such a system. You'd need to prove that it doesn't evolve into a problematic behaviour which sounds difficult.

Well, sure, and then Europeans wonder why Chinese and US AI labs moved so much forward.

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#27

We realize test driven development doesn't work, right? Any scientist worth... any salt will tell you that fitting data is the easy part. In fact, there's a very famous conversation between Enrico Fermi and Freeman Dyson talking about just this. It's something we've known about in physics for centuries Edit: Guys, I'm not saying "no tests", the "Driven Development" part is important. I'm talking about this[0]. | Test…

> We realize test driven development doesn't work, right? What do you mean with this? I'm a software engineer, and I use TDD quite often. Very often I write tests after coding features. But I see a huge value coming from tests. Do you mean that they can't guarantee bug free code? I believe everyone knows that. Like washing your hands: it won't work, in the sense you will still get sick. But less. So I'd say it does w…

TDD doesn't mean "code has tests". It means you write tests and then writing code to pass those tests.

It would be crazy for your code to not have tests...

https://en.wikipedia.org/wiki/Test-driven_development

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#29
post #23

We realize test driven development doesn't work, right? Any scientist worth... any salt will tell you that fitting data is the easy part. In fact, there's a very famous conversation between Enrico Fermi and Freeman Dyson talking about just this. It's something we've known about in physics for centuries Edit: Guys, I'm not saying "no tests", the "Driven Development" part is important. I'm talking about this[0]. | Test…

We realize that test driven development has a refactoring step, right? Science can happen there if the practitioner is smart enough.

That doesn't quite sound like TDD. I guess it could be. Are tests driving your code or are tests part of your code checking process?

In science we definitely don't let tests drive. You form a hypothesis, then you test that. But this is a massive oversimplification because there's a ton that goes into "form a hypothesis" and a ton that goes into "test that". Theory is the typical driver. The other usual one being "what the fuck was that", which often then drives theory but can simultaneously drive experimentation. But in those situations you're in an exploratory phase and there are no clear tests without the hypotheses. Even then, tests are not conclusive. They rule things out, not rule things in.

Re: A deep dive into self-improving AI and the Darwin-Gödel Machine

#30
post #10

This is genetic programming and is probably older than the authors. Did somebody just came up with a new term for an old concept?

Genetic algorithms applied as an AI agent… So… yeah…

This is fairly close to how Eurisko worked tbh.
Post reply on HN