Live data from Hacker News

Where does engineering go? Retreat findings and insights [pdf]

thoughtworks.com

11–20 of 34 posts

Re: Where does engineering go? Retreat findings and insights [pdf]

#11
post #6

> Engineering quality doesn't disappear when AI writes code. It migrates to specs, tests, constraints, and risk management. > Code review is being unbundled. Its four functions (mentorship, consistency, correctness, trust) each need a new home. > If code changes faster than humans can comprehend it, do we need a new model for maintaining institutional knowledge? The humans we have in these roles today are going to su…

I agree with the spirit of what you're saying, but...

> we have 50 years of good will built up with end users that the systems are reliable and repeatable

There's good yes, but also we've raced to build dystopian bullshit and normalized identity theft because most software is garbage. There might not be as much goodwill as you think. Software eats the world, and many simply feel helpless. The erosion of trust you're predicting has already happened, or never existed IMHO.

LLMs may not 1-shot reliable and repeatable systems, but they're a powerful tool that I hope will end up improving systems overall, for reasons you've mentioned, among others.

Re: Where does engineering go? Retreat findings and insights [pdf]

#12
> practitioners are exploring how to make incorrect code unrepresentable.

I'll say it again and again and again: Rust is the best language for ML right now.

You get super strict, low-defect code. If it compiles, that's already in a way a strong guarantee.

Rust just needs to grow new annotations and guarantees. "nopanic", "nomalloc", etc., and it would be perfect. Well, that and a macro-stripped mode to compile faster. I'd happily swap AOT serde compilation (as amazing as Serde is) for permanent codegen that gets checked in and compiles fast.

Re: Where does engineering go? Retreat findings and insights [pdf]

#13
given specification approach: personally i found it useful in some cases to write preceding block-comments for functions. you can describe the desired behaviour there, input/output types, etc. you can even make a skeleton from comment blocks and run one-shot generation. but this approach is especially useful in iterative development and maintenance.

Re: Where does engineering go? Retreat findings and insights [pdf]

#14

@dang this is a very interesting and relevant doc. I think it needs another chance at making it to the front page. This is a fairly easy to read doc discussing some of the challenges with using AI tooling in a forward thinking and disciplined way. Coming from Thoughtworks it also gives a bit of gravitas and legitimacy. There's good stuff in here. It would be a shame for the larger HN community to miss out on this con…

> Coming from Thoughtworks it also gives a bit of gravitas Why? I thought the opposite. Consultancies, of which thoughtworks is one, publish thought leadership as marketing material.

Mainly because Martin Fowler is part of their C suite

I agree that it's marketing material, but that doesn't instantly make it garbage. I've been reading their quarterly Thoughtworks Radar for a while now and it's clearly put together by people who understand the industry.

Re: Where does engineering go? Retreat findings and insights [pdf]

#16
> produced something more useful: a map of the fault lines where current practices are breaking and new ones are forming.

Here some story. Long time ago, i wrote a (software) accounting system. From 1st principles - nomenclatures, accounts, double-entry, transactions, balance (=current cached status), operations+reports on top of these. 5 tables (+1 for access control later). Very flexible and re-configurable into whatever one imagines. But anyway.

We deployed it at several places. The biggest one - retail with 50+ salepoints across whole region - was the most troublesome.. and after a month+ back-and-forth it dawned that.. they did have very well-working paper system of accounts/documents/data/values flow which was highly optimized for humans and the reality it was in (papers, remote places, delays, etc). Humans forget, make mistakes, displace things etc ; paper rots in time; distances make things out-of-sync - yesterdays invoices from village X will come tomorrow - maybe - .. etc. So their document flow - and even people-roles - were aligned with that system. Duplicating some things and completely avoiding others.

The new software had no such notions. There was no such thing as forgetting, displacing, out-of-balance. And while temporal stuff was fine, the document flow - even if consisting of same dot-matrix-perfect documents - was different to what they have used to. So.. it took them - and us - 3 months to retrain the personnel to unlearn their old system and to start actually using the new one properly, and enjoying the ride instead of fighting it.

Back to the topic.. i guess the old system of software engineering, built last 50+ years, has to be rearranged now. Not everything, but.. quite. Some things probably may wait for tomorrow, as the paper notes, but some - like roles and what they mean, and the cognitive/understanding chasm - is for yesterday..

Edit: after reading the whole paper, i think there are some things that can be "loaned" from hardware-design (chips etc) flows and processes. i see this analogy - the hardware's target environment (actual physical world, e.g. silicon etc) is also non-deterministic.. just mostly. Things like Requirements engineering, design-for-test ; all the enveloping (heat, power etc) and whatever else may come handy (i am not hardware dev, only seen these from aside, e.g. from a Verilog compiler)

Re: Where does engineering go? Retreat findings and insights [pdf]

#17
post #6

> Engineering quality doesn't disappear when AI writes code. It migrates to specs, tests, constraints, and risk management. > Code review is being unbundled. Its four functions (mentorship, consistency, correctness, trust) each need a new home. > If code changes faster than humans can comprehend it, do we need a new model for maintaining institutional knowledge? The humans we have in these roles today are going to su…

Same, I'm seeing people having a lot of difficulty working with agents and providing prompts that can have the agent go end-to-end on the work. They just can't write prose and explain a problem in a way that the agent can go out and work and come back with a solution, they can only do the "little change with claude code" workflow and that just makes you less productive. I don't think the industry is ready or has the…

People just need to lower their expectations a bit. There's a large space between "prompting for end-to-end solution" and "little change".

Re: Where does engineering go? Retreat findings and insights [pdf]

#18
post #8

Earlier quoted context omitted.

> Coming from Thoughtworks it also gives a bit of gravitas Why? I thought the opposite. Consultancies, of which thoughtworks is one, publish thought leadership as marketing material.

> "Where does the rigor go?" > Engineering quality doesn't disappear when AI writes code. It migrates to specs, tests, constraints, and risk management. These are generic "thoughts" you can get from any agency pushing AI SDLC. The pages I read through left me wondering if there was even a real retreat.

You're right that this isn't some groundbreaking revelation. If you're using AI enough to be feeling it, you're feeling/seeing what they're talking about. The purpose of a paper/retreat like this it get it all together and written down on paper, then to disseminate it to the wider world. I think the paper does a good job of collecting info that isn't wrong, and which has enough info to help guide folks making decisions.

Re: Where does engineering go? Retreat findings and insights [pdf]

#19
> The product management side of this equation is equally unsettled. If developers are now thinking more about what to build and why, they are doing work that used to belong to product managers

It's not clear to me why this is true. If LLMs are writing code, why are developers simply not orchestrating the completion of more features instead of moving up the stack to do product development work? Is there some implication that the existence of LLMs also enables developers to run user studies, evaluate business metrics and decide on strategy?

Additionally, if PMs can use LLMs to increase velocity in their work why not focus on all the things that used to be deprioritized? Why, with the freed up time, is generating code the best outcome?

These questions likely have different answers depending on organization size but I'm not sure I understand why orgs wouldn't just do more work in this scenario instead of blending responsibilities. It's not like there's infinite mental bandwidth just because an LLM is generating the code

Re: Where does engineering go? Retreat findings and insights [pdf]

#20
post #4

@dang this is a very interesting and relevant doc. I think it needs another chance at making it to the front page. This is a fairly easy to read doc discussing some of the challenges with using AI tooling in a forward thinking and disciplined way. Coming from Thoughtworks it also gives a bit of gravitas and legitimacy. There's good stuff in here. It would be a shame for the larger HN community to miss out on this con…

Ok, let's give it a try. (Btw, @dang doesn't work reliably - for that you need to email hn@ycombinator.com. I only saw this by accident.)

I think the original title is better than the current one, though: "The future of software engineering – [Thoughtworks] retreat findings and strategic insights"
Post reply on HN