Sounds pretty interesting, I was thinking that would be the way to work past limited context window sizes automatically. > Codebuff has limited free usage, but if you like it you can pay $99/mo to get more credits... > One user racked up a $500 bill... Those two statements are kind of confusing together. Past the free tier, what does $99/month get you? It sounds like there's some sort of credit, but that's not discus…
Ah, good catch. We (read: I) introduced a bug that gave customers $500 worth of credits in a month as opposed to the $100 they paid for, and this user saw that and took advantage. Needless to say, we fixed the issue and added more copy to show to users when they _do_ exceed their thresholds. We haven't had that issue since. And of course, we ate the cost because it was our (expensive!) mistake. The user had spent the…
Have you considered a bring your own api key model?