Scary. For the first time in my life, I feel like my expertise is at risk of being rendered obsolete. Maybe not this year, but the writing is on the wall. Soon coding without an AI will feel as antiquated as delivering food by horse. And resistance is futile because markets will punish those who refuse. We'll probably need less and less developers as AI advance. Just like we need less manual labor in farms today. And…
It feels absurd. A Chat-GPT4 model will generate unit tests? Hallelujah! I hate writing tests! Yay! Except how do you know it's generating the right tests? Can it explain its reasoning? Unit tests are a weak form of automated specification. Why are we inferring our specifications from examples to begin with? Who is going to walk through the reasoning and verify these are the right tests and make sense and specify the…
> But that's what we get with humans, right? No!
> Humans can explain their reasoning.
can you explain your reasoning as to why a language model would never be able to match a human's ability to explain its reasoning?
i've met a lot of humans that are quite bad at this, and i will likely never know for sure why they wrote the unit tests that they wrote unless i rewrite those tests to myself.
but if you have them explain their reasoning enough, and if that reasoning is plausible enough, and if the relationship between that reasoning and what they did is strong enough, consistently enough — you start to trust them.
you don't trust gpt4 to write code for you. which makes sense. but that doesn't mean as much as you think it means, i think.