Live data from Hacker News

The Waymo effect: how AI is quietly making research less collaborative

researchagenda.news

251–260 of 311 posts

Re: The Waymo effect: how AI is quietly making research less collaborative

#251

I wonder if AI is making us dumber I can have AI pull some analysis - sql query, crunch some numbers and bam, some precise sounding number. But then I question it, and then it says "you are right, I didn't check that" How did I know what to question? By doing the friction work of querying myself, calculating myself, and then getting questions from leadership. I worry about the younger generation. They spit out Claude…

Pre-LLMs: anyone can generate ideas, the implementation is what matters

Post-LLMs: anyone can generate implementations, the ideas are what matter

Re: The Waymo effect: how AI is quietly making research less collaborative

#252

Beautifully written essay. The benefits of serendipity are intractable by design whereas throughput gains can be readily measured (or at least we think so). The OP notes a point - "who did you think with?" -- maybe there are points based on some social graph, that adds weightage to a particular output? Edit : Other posters have said it is AI generated, I did not catch it, but felt the point was well-made. I dont know…

> Beautifully written essay. Agreed! Great flow, structure, no BS, really good! I would wager this didn't use LLM help to be written. Though if I'm wrong I'd really like to know and would be very impressed. (And if I'm right then the article is an illustration of its own message. You don't learn how to write such essays without having practised it for many years without opting for the easy way of letting the LLM do t…

It absolutely was used, and heavily. I won't even cover the "it's not ___, it's ___", of which there are MANY in this piece. But beyond that:

Count the lists of three:

    A guilt-free space to be alone with one's thoughts, finish an email, or take a call en route without the awkwardness about conducting it in front of a stranger.

   It costs travel and scheduling and the glacial work of building trust. It costs ego management and compromise and the periodic small heartbreak of the author-order negotiation.
Look for referenced to "naming" things, used in the sense of "identify" or "realize" rather than, you know, naming something.

    It took us slightly longer to name what we had lost.

    Swap “pilot” for “researcher” and “autopilot” for “agent”, and the mechanism Wang is guarding against is the one Bainbridge named four decades earlier.

Look for things being done "quietly":

    Two people who had crossed continents to talk to each other were quietly delighted by a technology whose central feature is that you don’t have to talk to anyone. (ed. - is that *really* Waymo's central feature?)

    once a frictionless option exists, we take it by default, and quietly surrender whatever the friction was doing for us

    Every conversation redirected from a colleague to a chatbot is a thread quietly withdrawn

    while the invisible thing that sustained it quietly falls below threshold

    competence quietly erodes precisely because it is needed only rarely

    the quiet risk is that our incentives are training us

Re: The Waymo effect: how AI is quietly making research less collaborative

#253

Earlier quoted context omitted.

Wow, oddly similar thing happened to me. Anecdotally, I was working with a non-developer. She was building a reporting dashboard with Claude. I pointed out that the system she built was using the filesystem to store one line notes about the report, and I said "I would probably tell the agent to use a database for that, but it's not the end of the world if it works". And she replied "Claude said the developer's right,…

>> I'm not against fact checking, but it absolutely felt like a punch in the gut coming from a non-dev. There was no "trust" there. She couldn't rely on my expertise, she had to go back to her "source of truth" (Claude) and asked for a second opinion on something that she wouldn't be able to verify. This is probably how physicians feel when informed patients (whether using LLMs or not) ask questions (good or bad) dur…

This is a different situation. A doctor is a domain expert, but you are in possession of vastly more empirical data about your specific body. Getting to a good result is going to be easier with collaboration, rather than one of you confidently telling the other what the problem/solution is.

Re: The Waymo effect: how AI is quietly making research less collaborative

#254
post #32

I work at an intersection of tech, applied research, and science. Something I’ve noticed in collaboration that does occur is an increased confidence in people outside their domains to say things with conviction. I have people who have limited experience with software pushing out layers and layers of abstracted code that’s fairly sophisticated but often misguided in intent who will say what they’re doing is correct, w…

> It’s making me want to be a lot less collaborative with such individuals. I don’t want to sit around and refute Claude text outputs all day.

I echo the sentiment. It's frustrating to try to collaborate with a Claude/ChatGPT meat proxy.

You can write a very thoughtful two-line question over 5 minutes and get a 5 page design doc back in a minute.

Re: The Waymo effect: how AI is quietly making research less collaborative

#255
post #36

For software developers, the equivalent is writing software without beta testers. If you don’t seek out users, you will likely build something nobody else wants. And, that’s what I do. I’m retired and I use AI to build websites for myself. If anyone else ends up using it, that will be a happy side-effect. If we want to do collaboration, we are going to need to do it intentionally rather than relying on side effects l…

Counterpoint: most Open Source projects are (or started off as) programs people built for themselves, and anyone else ending up using them was a happy side-effect.

And yet, many people have ambitions. They will put up a website about how great their software is and how everyone should use it.

I usually put a warning that it's experimental and might not be maintained. More users, more problems.

(And yet, I'll confess to be slightly disappointed that nobody is using software that I didn't promote.)

Re: The Waymo effect: how AI is quietly making research less collaborative

#256
post #32

I work at an intersection of tech, applied research, and science. Something I’ve noticed in collaboration that does occur is an increased confidence in people outside their domains to say things with conviction. I have people who have limited experience with software pushing out layers and layers of abstracted code that’s fairly sophisticated but often misguided in intent who will say what they’re doing is correct, w…

Wow, oddly similar thing happened to me. Anecdotally, I was working with a non-developer. She was building a reporting dashboard with Claude. I pointed out that the system she built was using the filesystem to store one line notes about the report, and I said "I would probably tell the agent to use a database for that, but it's not the end of the world if it works". And she replied "Claude said the developer's right,…

> Treating AI as if the output is factual is just a misuse of the tools, I think.

Especially because it's very often wrong. AI tools lack the necessary context of the specific situation and the surrounding technology environment to make appropriate suggestions for anything more complex than clean sheet designs and toy prototypes. There is too much complexity that is hidden in domain knowledge and not even exposed fully in documentation for any AI tool currently to ingest it all into its own context to give you an accurate answer, even setting aside hallucinations and that these tools are incapable of reasoning.

I have this same gut punch constantly. AI has destroyed functional outcomes in corporations, because managers are all deep in AI psychosis deciding that whatever the tool says is perfectly correct at all times. We've replaced analysis paralysis with a complete absence of thought from any human in high-level impactful strategy discussions, everything is entirely being abdicated to AI tools in so many companies. It's ridiculous.

AI will radically change the economy, but not because its replacing jobs, but because its eroding trust, domain knowledge and expertise, and thinking/creativity while being a massive waste of money and total boondoggle. This bubble can't burst soon enough so we can get on with doing shit that actually matters for people that actually helps them.

Re: The Waymo effect: how AI is quietly making research less collaborative

#258

Earlier quoted context omitted.

My point is that wanting things redone because you don’t understand it is dumb behaviour, not smart behaviour. There wasn’t even a denial of the validity of experience, I was just trying to examine the problem - if this behaviour is something you see often exhibited by “smart” people then: either you are unable to convince them of your side of the argument for different reasons, or you are not actually arguing with s…

> My point is that wanting things redone because you don’t understand it is dumb behaviour, not smart behaviour. Smart people can do very non smart things when they feel their status as smartest-person-in-the-room is threatened, which is the entire point. > There wasn’t even a denial of the validity of experience, I was just trying to examine the problem - if this behaviour is something you see often exhibited by “sm…

I was responding to you in the context of the GP.

> The flip side of being confidently wrong sometimes is that we treat understanding new systems as something approachable. So, yeah, it's annoying that we don't stay in our lane, but, from my boss's perspective, I'm the only one who's actually willing to just read code, investigate, possibly read a paper, and figure out what's going on instead of punting and saying it's someone else's turf I'm blocked until they get back to me.

Eventually you have to understand something. And part of that process is being wrong and annoying people.

GP here is suggesting that accepting established status quo at face value (i.e relying solely on other people's experience/letting them deal with problems you face in their domain without being able to examine why they arrived at the decisions they did) can lead to worse outcomes, and I agree.

Your response was that it is frustrating to have someone walk in and question things (precisely what GP is suggesting), only to have the final product of whatever decisions these people make be worse than the status quo (not what GP is suggesting).

I responded by saying - there is a difference between not listening to experience and examining whether the resulting implementation/decisions based on the experience are actually valid.

You did not address that. Is there not a difference between these two things? GP is suggesting to do the latter, not the former. i.e question why things are the way they are, crucially not that people should make decisions based on things we don't understand about the status quo.

You only responded to - * I doubt that someone smart (as you put it) would deliberately want things redone because they don't understand it, that's a trait borne of arrogance not intelligence.*

Your response claimed that I am denying the validity of your experience, when I made no such statement. All I said was there is a difference between questioning things and forcing decisions based on things they dont understand - smart people don't do the latter, arrogant people do. Someone doing what you are suggesting, is not doing what GP is suggesting, they are different. The former is smart, and the latter is not smart.

When I pointed this out here: I was just trying to examine the problem - if this behaviour is something you see often exhibited by “smart” people then: either you are unable to convince them of your side of the argument for different reasons, or you are not actually arguing with smart people. Do you see the distinction?

You accuse me of gaslighting you.

> Intelligence and arrogance are somewhat contra-indicative.

There might be a trend of this in academia (which is where the xkcd joke stems from), but in my personal experience I dont see this much in industry, and you can disagree with that.

I also don't see an xkcd joke being an actual basis of anything either. You are making declarative statements - but a _lot_ that many physics (and pure mathematics) grads are enormously more arrogant than the general population, enough that the trend under discussion has actual basis. - without any backing of this other than anecdata, and I was pointing out a different anecdotal experience.

Re: The Waymo effect: how AI is quietly making research less collaborative

#259
post #32

I work at an intersection of tech, applied research, and science. Something I’ve noticed in collaboration that does occur is an increased confidence in people outside their domains to say things with conviction. I have people who have limited experience with software pushing out layers and layers of abstracted code that’s fairly sophisticated but often misguided in intent who will say what they’re doing is correct, w…

Wow, oddly similar thing happened to me. Anecdotally, I was working with a non-developer. She was building a reporting dashboard with Claude. I pointed out that the system she built was using the filesystem to store one line notes about the report, and I said "I would probably tell the agent to use a database for that, but it's not the end of the world if it works". And she replied "Claude said the developer's right,…

I'd bet it depends on what they write to the LLM, since sycophancy is so strong in these things. If they write in a fairly agnostic way, it might default to sycophancy to you the dev, while if they write it in an opinionated way it might default to sycophancy to them. Regardless of who is right.

Re: The Waymo effect: how AI is quietly making research less collaborative

#260
post #32

I work at an intersection of tech, applied research, and science. Something I’ve noticed in collaboration that does occur is an increased confidence in people outside their domains to say things with conviction. I have people who have limited experience with software pushing out layers and layers of abstracted code that’s fairly sophisticated but often misguided in intent who will say what they’re doing is correct, w…

Wow, oddly similar thing happened to me. Anecdotally, I was working with a non-developer. She was building a reporting dashboard with Claude. I pointed out that the system she built was using the filesystem to store one line notes about the report, and I said "I would probably tell the agent to use a database for that, but it's not the end of the world if it works". And she replied "Claude said the developer's right,…

I think I could qualify as an expert on various topics relative to many average people. But it always bothered me when experts wanted to "just be believed". In your example, it doesn't long to explain why a database is better than the file system in this instance and a moderately intelligent should be able to understand and not need you or Claude as the source of truth.

So I think it can be good people are able to "AI" to question expert opinions - though naturally, as you say, it's bad if people take the AI as a single authority akin to an expert.

Post reply on HN