Earlier quoted context omitted.
I wasn't worried until Google showed up with a 1M token context with 99.9% recall...
Some random team at Berkeley beat them to it by a couple days: https://largeworldmodel.github.io/ . It's just a matter of throwing compute at it, nothing fancy. OpenAI could probably do 1M token context too but they haven't yet found a way to make it profitable (neither have Google; the most they actually offer customers is 256k).
There is a reason why we still have people working at McDonald's even though fully automating it has been possible for a couple of decades now.