Earlier quoted context omitted.
What makes you think we're lacking fundamental plumbing? I am personally still quite convinced it will simply take a bit of time and development to plug in the current AI into sufficient self-testing structures (basically the next versions of AutoGPT) and let it run long enough to map out an entire domain with accurate measurements. Seems more like just a matter of time and a bit of funding - but mostly inevitable an…
I completely agree with you. I failed to articulate it well. Like the current top HN post suggests ( https://eugeneyan.com/writing/llm-patterns/ ), we’re still discovering patterns that work well with LLMs. That said, anecdotally - they already excel at being logic engines. Capable of filling in the gaps between instructions. Using their worldly knowledge or “common sense” to do so. But ever so often, they’ll miss an…
Coincidentally, that appears to be how GPT4 was made - apparently it's actually about 8 personas with designated roles running GPT3.5 trained together ("Panel of experts"? there's an AI name for the technique). Makes you wonder how far that one trick scales.
(P.S. great link. Gah - another long read on the todo list)