I think the deeper need is a "self-review" flow. People push AI-reviewed code like they wrote it. In the past, "wrote it" implies "reviewed it." With AI, that's no longer true. I advocate for GitHub and other code review systems to add a "Require self-review" option, where people must attest that they reviewed and approved their own code. This change might seem symbolic, but it clearly sets workflows and expectations…
After outages, Amazon to make senior engineers sign off on AI-assisted changes
491–500 of 510 posts
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#492Earlier quoted context omitted.
Spec should be made before hand and agreed on by stakeholders. It says what it should do. So it’s for whoever is implementing, modifying, and/or testing the code. And unfortunately devs have a tendency of poor documentation
Software development is only 70ish years old and somehow we have already forgotten the very very first thing we learned. "Just get bulletproof specs that everyone agrees on" is why waterfall style software development doesn't work. Now suddenly that LLMs are doing the coding, everyone believes that changes?
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#493Earlier quoted context omitted.
Self review should also include adding guiding comments for other reviewers.
Do you add these into the code or into the review itself? I sometimes write these into the review, but I wonder if it's a useful information that should actually be inside the code that will get lost when the PR is merged
So there is reason to add comments that address a different readers understanding than the code rest.
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#494Earlier quoted context omitted.
> Create conflicting metrics for performance, push credit up and responsibility down, punish everyone below you for not meeting the double standards This resonates with my experience. The only thing you forgot is that you can also use the 12^H^H 14 leadership principles to argue whatever you want (and then the opposite of what you argued last month, still using the same leadership principles).
Got a project finished early? Well, you didn't insist on the highest standards. Made sure things were held to a high standard? Well, you weren't biased for action. Were you a knowledge source for the entire team? Well, you weren't learning and being curious. Did you ask a lot of questions to learn everything? Well, then you weren't "are right a lot". Did you think big and come up with an architecture that saved Amazo…
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#495Earlier quoted context omitted.
But it gets less mandatory the more layers up you go. If I get an email from an SVP that is CC: the entire division saying everyone should go to a meeting I will almost certainly be able to ascertain the contents of that meeting in 10 seconds from someone else who did attend
Surely your boss notices your non-attendance.
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#496Earlier quoted context omitted.
The subject of the media coverage is not AWS, it is a peer organization to AWS that runs using significant amounts of non-AWS infrastructure. They are both part of an umbrella called Amazon but are not at all the same thing. Maybe your CoT-level reasoning isn’t so robust.
It's hard to that this objection seriously. The publication is literally called the Financial Times. It's not exactly crazy for them to think that their readers might care about the entity that shows up the stock ticker rather than how the company happens to divide up things internally. Even if it weren't a finance publication, I have trouble imagining you making this argument if a headline said something like "Googl…
The cause and effect statements just don’t correspond to reality.
I guess I’m stuck on the idea that the actual facts are relevant. If the question instead is how the dance of optics and PR is going in the minds of people who don’t know enough to doubt what they read, I don’t know what to say about that.
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#497Earlier quoted context omitted.
> Create conflicting metrics for performance, push credit up and responsibility down, punish everyone below you for not meeting the double standards This resonates with my experience. The only thing you forgot is that you can also use the 12^H^H 14 leadership principles to argue whatever you want (and then the opposite of what you argued last month, still using the same leadership principles).
Got a project finished early? Well, you didn't insist on the highest standards. Made sure things were held to a high standard? Well, you weren't biased for action. Were you a knowledge source for the entire team? Well, you weren't learning and being curious. Did you ask a lot of questions to learn everything? Well, then you weren't "are right a lot". Did you think big and come up with an architecture that saved Amazo…
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#498Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#499Earlier quoted context omitted.
When an SVP asks you to do something in a mass email, it's very much optional. Dave Treadwell is an SVP, his org is likely in the 10's of thousands, there is no way to even have a mandatory meeting for that many people. My SVP asks me to do things all the time, indirectly. I do probably 5% of them.
are you saying SVP’s words are not important and should be ignored? This is not what I remember back in the day when Bezos sent his email with a question mark (or maybe !)
Personally I would say that an SVPs words are not important and don't need to be ignored.
It's like a politician talking about abstract policies. Yes they do sort of affect me, but they don't require any affirmative action on my behalf any more than the wind does.
Re: After outages, Amazon to make senior engineers sign off on AI-assisted changes
#500Reviewing AI generated code at PR time is a bottleneck. It cancels most of the benefits senior leadership thinks AI offers (delivery speed). There’s also this implicit imbalance engineers typically don’t like: it takes me 10 min to submit a complete feature thanks to Claude… but for the human reviewing my PR in a manual way it will take them 10-20 times that. Edit: at the end real engineers know that what takes effor…
Indeed. My view as a CEO is, if you are still reviewing the code yourself then what use is it that you can produce a bunch of text at a faster rate? I'd prefer people wrote good quality code and checked it as they went along... whilst allowing room for other stuff they didn't think of to come to the front. The production process of using LLMs is entirely different, in its current state I don't see the net benefit. E.…