Token Arbitrage: Use Sol for coding, Luna for compaction, save 84%
1–3 of 3 posts
Re: Token Arbitrage: Use Sol for coding, Luna for compaction, save 84%
#2Is this using the server side compaction of the responses API?
Re: Token Arbitrage: Use Sol for coding, Luna for compaction, save 84%
#3Is this using the server side compaction of the responses API?
No, server-side compaction is inherently tied to the model's current context. This uses a full side prompt to get the compaction result, then swap the context with new compaction result. I did a bunch of tests and the results from Luna were indistinguishable from Sol