Anthropic has been avoiding the hard thing, but they just need to do SOME kind of pricing thing here to shift demand. I expect there is just no amount of tricks that can handle the few hours at peak load. They need "surge pricing". This seems reasonable surge pricing approach to me: 1. Implement surge pricing for everyone for the peak 2 hours of the day if possible. 2 hours you can work around, 5 hours is too hard. 2…
Generally if you give people unused cycles to burn, they'll feel entitled to finding ways to burn them. So someone who is hitting the wall at x5 goes x20 and now has an extra +x10 to burn. Again, that's good if hardware is sitting around idle and you're encouraging innovation and exploration. It can make less sense when resources are scarce.