The overarching message is that builders should deeply consider the impact of what they're building on civilization. "Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it." Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity." The questions shouldn't just be 'can we buil…
hard disagree. No matter what gets built, it will be used for bad things if the society is not properly constructed. We need to fix our government and then you can build anything you want. I don't like putting the blame on the builders, building is already difficult as it is. Also you can't built something in isolation, word will get out anyway. That's why this speech is either naive or he just wanted to tick a todo…
Magnifica Humanitas
631–640 of 1001 posts
Re: Magnifica Humanitas
#632The overarching message is that builders should deeply consider the impact of what they're building on civilization. "Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it." Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity." The questions shouldn't just be 'can we buil…
Not new for software and hardware industry though, practitioners have just chosen to ignore it. From the Association for Computing Machinery, which encompasses all forms of software development, the very first principle is the public good: " Software engineers shall act consistently with the public interest. In particular, software engineers shall, as appropriate: 1.01. Accept full responsibility for their own work.…
Re: Magnifica Humanitas
#633Earlier quoted context omitted.
I worry that companies like Anthropic, which are moving toward RSI, may prioritize speed over the timely identification of irreversible risks.
Did you mean AGI? I'd think whatever else they are doing, LLMs are reducing RSI...
Re: Magnifica Humanitas
#634>“technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it,” If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts
I feel much much smaller version of it already happened. Many many customer facing processes in companies (from customer support to lost & found departments) almost all automated to a point if you are outside of the norm you are screwed. Time you are going to spent is higher than the value you are going to get most of the time. For the very same reason these companies are very anti-diversity. Because everything desig…
Re: Magnifica Humanitas
#635Earlier quoted context omitted.
Have you ever successfully appealed a failed HR screen? IME the reality of the modern world that there's little genuine appeal or reconsideration anymore. There is some sort of process but it's Byzantine and if we're talking the government, expensive. I guess everyone has had different lives but between humans and algorithms I take the algorithm every time.
What I'm saying is that pre-AI, at least a human would skim it, and maybe see something that caught their eye that wasn't on the keywords list. Or if it were an internal referral that used to guarantee at least a call with a recruiter or HM.
Re: Magnifica Humanitas
#636Earlier quoted context omitted.
Not new for software and hardware industry though, practitioners have just chosen to ignore it. From the Association for Computing Machinery, which encompasses all forms of software development, the very first principle is the public good: " Software engineers shall act consistently with the public interest. In particular, software engineers shall, as appropriate: 1.01. Accept full responsibility for their own work.…
I think not just (computer) scientists but the general population thinks to serve the common good makes sense, not last because we understand it's eventually for our own good. It is however just that very small minority of the population with highly psychopathic/narcissistic traits - those that, in pre-historic times, would have been kicked out swiftly of hunter & gatherer / small village communities because of their…
Most likely the same kind of Machiavellian political maneuvering was effective in those groups as well.
Re: Magnifica Humanitas
#637>“technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it,” If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts
Substitute technology for religion and he's probably one of the least authorized persons to question this.
Re: Magnifica Humanitas
#638Earlier quoted context omitted.
Have you ever successfully appealed a failed HR screen? IME the reality of the modern world that there's little genuine appeal or reconsideration anymore. There is some sort of process but it's Byzantine and if we're talking the government, expensive. I guess everyone has had different lives but between humans and algorithms I take the algorithm every time.
What I'm saying is that pre-AI, at least a human would skim it, and maybe see something that caught their eye that wasn't on the keywords list. Or if it were an internal referral that used to guarantee at least a call with a recruiter or HM.
And ChatGPT has the benefit of being able to do 10-100x as many screens as with a human. Even if it's grossly wrong half the time I'm ahead on volume.
Re: Magnifica Humanitas
#639> As Pope Francis warned, we must realistically ask ourselves who holds this power today and how they use it: “It must also be recognized that nuclear energy, biotechnology, information technology, knowledge of our own DNA, and many other abilities which we have acquired… have given those with the knowledge, and especially the economic resources to use them, an impressive dominance over the whole of humanity and the…
This was an almost sickening sentence to read on so many levels.
Re: Magnifica Humanitas
#640>“technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it,” If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts
But the technology that outputs decisions can also output reasoning that justifies such decisions. When a judge or a jury outputs a decision THEY are also a black box and you can only evaluate said decisions on reasoning THEY also output. I’m not taking a side here. I’m just saying this reasoning is flawed.
They are not a black box, they passed rigourous examinations and they stick to principles enshrined in constitutions and laws.
Technology, or better, the productization of it, is instead the result of the interest of very few powerful individuals or corporations and aggressive product market fit iterations.
The bullish discourse around the PMF loop says that this is good because it is better at solving people's problems. But after a few decades it is obvious there's a gigantic risk the process actually exploits people's problems instead of actually solving them.