Live data from Hacker News

AI Is Breaking This Thing We Call Trust

terriblesoftware.org

11–20 of 60 posts

Re: AI Is Breaking This Thing We Call Trust

#11

> AI Is Breaking This Thing We Call Trust An increasingly large percentage of people being lying POS grifters is breaking trust. AI just happens to be a tool that the laziest of that group of people leans on a lot to supercharge their grifts. But our massive and growing trust problem predates and is way deeper than AI.

Yeah, I think what they really mean is people, especially those with power, broke this thing called trust and now they're trying to use """ai""" as a scapegoat.

It'd be along the same lines as saying "I was drunk driving 75km/hr over the limit down a busy suburban road during the middle of the day and 5 people died because of it so we CAN NOT TRUST CARS"

And everyone stands up and claps

Re: AI Is Breaking This Thing We Call Trust

#12

> Here’s the thing: most of our habits at work still assume that producing something means you have to understand it. This has only ever been true in a relative sense. Until recently, one was expected to understand the software-level code they wrote. But not the machine code, or the computer internals at a deep level. You trust that those layers work. At some point in the past you couldn’t just trust that. At some po…

Then put your money where the mouth is and start committing prompts and having your LLM “compile” them with each production release.

Re: AI Is Breaking This Thing We Call Trust

#13
The elite broke trust.

No one made people like Sam Altman into a compulsive liar. No one made Musk call a service full self driving, and then make it return liability to the user the second it decides an accident is about to happen.

Stop removing agency from the people making the top level decisions and reaping all the rewards.

Would you claim that someone who took 5 shots in a row and drove home wasn’t responsible for an accident because the car was what physically did the damage?

Re: AI Is Breaking This Thing We Call Trust

#14

> Here’s the thing: most of our habits at work still assume that producing something means you have to understand it. This has only ever been true in a relative sense. Until recently, one was expected to understand the software-level code they wrote. But not the machine code, or the computer internals at a deep level. You trust that those layers work. At some point in the past you couldn’t just trust that. At some po…

You trust machine code because it was produced by a deterministic system that was written and tested thoroughly by other engineers. AI systems are not the same. You can't guarantee deterministic output. Also, code is still the best language we have to convey our intentions as engineers into function. Natural language is too imprecise and ambiguous. Understanding the code allows us to understand the intention behind t…

Are your teammates deterministic output machines?

Re: AI Is Breaking This Thing We Call Trust

#15
I worry for the next generation.

You and I have a baseline. A brain that did most of it’s developmental phase while there was still some unified accepted version of truth (even if dubious)

Future generations will have to develop in a more splintered reality. A world where there is nothing to hold on to. Not even a dubious commonly accepted narrative

Re: AI Is Breaking This Thing We Call Trust

#16

Earlier quoted context omitted.

You trust machine code because it was produced by a deterministic system that was written and tested thoroughly by other engineers. AI systems are not the same. You can't guarantee deterministic output. Also, code is still the best language we have to convey our intentions as engineers into function. Natural language is too imprecise and ambiguous. Understanding the code allows us to understand the intention behind t…

Are your teammates deterministic output machines?

In a sense yes. I trust that my coworkers will be accountable for their outcomes and accomplish them with the high quality bar I know they intrinsically hold themselves to. And that they understand our shared goals and if they don't, they will work to become aligned.

And if I can't say that for a coworker, well, that's performance feedback.

Re: AI Is Breaking This Thing We Call Trust

#17

Earlier quoted context omitted.

Are your teammates deterministic output machines?

In a sense yes. I trust that my coworkers will be accountable for their outcomes and accomplish them with the high quality bar I know they intrinsically hold themselves to. And that they understand our shared goals and if they don't, they will work to become aligned. And if I can't say that for a coworker, well, that's performance feedback.

Highly likely, your trust is just based on your feelings, and they don't do much for the product quality.

Re: AI Is Breaking This Thing We Call Trust

#18

Earlier quoted context omitted.

You trust machine code because it was produced by a deterministic system that was written and tested thoroughly by other engineers. AI systems are not the same. You can't guarantee deterministic output. Also, code is still the best language we have to convey our intentions as engineers into function. Natural language is too imprecise and ambiguous. Understanding the code allows us to understand the intention behind t…

Are your teammates deterministic output machines?

At least the tools they used to use used to be so...Now the tools do this https://blog.coredump.cx/p/recursion-into-madness

Re: AI Is Breaking This Thing We Call Trust

#19

> Here’s the thing: most of our habits at work still assume that producing something means you have to understand it. This has only ever been true in a relative sense. Until recently, one was expected to understand the software-level code they wrote. But not the machine code, or the computer internals at a deep level. You trust that those layers work. At some point in the past you couldn’t just trust that. At some po…

I don't think that's the problem the source article is describing. I've seen a number of instances now where people produce work product they don't understand at any level. "Hey Claude, design this feature and send it out for review, thx!" will often seem to work if you don't know any better.
Post reply on HN