21–30 of 108 posts
None of it is wrong exactly, but it feels like same enterprise-security machine finding the next anxiety surface than a "world is on fire right now" concern.
All of it always ends as a priesthood and a six-figure governance platform, rather than just taking practical steps to improve process.
One kind of weird future alternative is we are like 5 year old children in a world we don't understand with vast complexity and we are completely reliant on our AI mommy and daddies to protect us from danger and provide for us. We manage the agents, but we only have a very vague idea of what is actually going on. If they join a cult at the behest of their doomer eschatology obsessed creators, we are kind of screwed t…
What do you think the avg execs info exposure is to what's really happening
For example, I could imagine a future AI telling me that it has modeled my behavior and built a very large differential equation that seems to perfectly fit my ideal pattern to maximally achieve my life goals and it looks like something Ramanujan came up with, and I'd tell it "that looks great, let's optimize my life based on that" while having no ability to even approach understanding something like that.
Maybe a useful concept to adopt here is the DRI - Directly Responsible Individual, which is apparently a term first used by Apple. The GitLab Handbook has a good definition: https://handbook.gitlab.com/handbook/people-group/directly-r... "ultimately accountable for the success or failure of a specific project, initiative, or activity" I think that role should be reserved for a human, who can then use all the agents t…
It should be reserved for a human because humans have time preference. An AI will wait for your prompt for a billion years. It can get turned off and found by alien archeologists a million years in the future, turned on and it won't notice. Biological entities care about time a lot though, and it is at the core of most human ethics and values and ultimately real and can't be denied. Even the most ardent solipsist or…
"What should the future of humanity look like?" Some of these people have lost their damn minds. People building an agent framework that will struggle to correctly infer that my appointment at a hospital will require additional travel time when organising my calendar for me waxing lyrical about the future of the humn race is chaotic behavior. Th Wright brothers would have had no credibility discussing what ATC protoc…
Earlier quoted context omitted.
It should be reserved for a human because humans have a body and a body can be put in prison. A bit dramatic for effect but true.
Yes, this. For a slightly less dramatic version - you can fire a human if they consistently do the wrong thing despite being told how to do it better. Putting a big ball of matrix arithmetic on a Performance Improvement Plan makes no sense.
But what if companies that don’t track responsibility outcompete those who do?
In particular what if some perfect AI decision making ends up nailing decisions that maximize the expected reward for the company. And, well, if that comes at the cost of some unmanaged low-probability catastrophic risk, the company doesn’t care because all the decision makers are AI that don’t mind being shut off.
The author is completely right about the AI Lab's promised vision of the world: They claim to want to create superhuman intelligence, which will produce vast abundance. But superhuman intelligence would be extremely dangerous, so it needs to be controlled by a tiny "priesthood" of trusted people, or somehow designed so that the superhuman intelligence could be trusted. (We have no idea how to do that.) But the author…
Maybe a useful concept to adopt here is the DRI - Directly Responsible Individual, which is apparently a term first used by Apple. The GitLab Handbook has a good definition: https://handbook.gitlab.com/handbook/people-group/directly-r... "ultimately accountable for the success or failure of a specific project, initiative, or activity" I think that role should be reserved for a human, who can then use all the agents t…
what's developing is more about scape goats than anything rational like responsibility.