Earlier quoted context omitted.
> In the $150/mo range you can get effectively unlimited usage of GPT 5.6 Sol (Pro plan) Not true. Sol on XHigh or Max runs out even on the $200/mo plan. It's not close to effectively unlimited. Maybe at 2x the current allowance it can.
What are you doing where you're getting Sol on XHigh or Max to run out on the $200 plan? Last night, I had 48% of my weekly limit left, so I spun up 4 projects I had been working on and ran them all on Ultra with Fast mode and /goal, and it took over 4 hours to burn through that. I mean, I was reeeeally trying to use it up because I just can't use it up with normal usage for weekend and after-work programming. I've h…
Real work. $200 looks good on the outside until the essence of it, e.g. the models lie. I gave a list of spec to Sol and Sol decided some items didn't need to be done and the reason was "unproven", "not enough evidence", etc.
They all come up with amazing ways to lie (or be lazy). Often times what you get isn't what you asked for (only on the surface). E.g. I ran it to iteratively bench and optimize a better data structure for the project. It spent hours and finally came up with something. When I check it out -- it benchmarked the wrong criteria and was way off. So here we go again. Most AI work looks good on the surface. There are infinite edge cases.
So to do real work and gate it you need to:
1. Plan
2. Get it to do the work
3. Get independent agents to check from different angles
4. Take that feedback and get it to fix those gaps
5. Match against the plan and redo parts if needed
Every task is easily 4-5x the estimated amount of tokens.
p.s. well I did burn some banked resets building a compiler for some language AND it is still NOT done. Every time it says done I say check it says ok we still have bugs...