Rookie mistake - it seems like they didn't follow manufacturers' guidance when installing the 10x engineers. One needs to clearly define which metric should be 10x'd before powering them up.
Codex on AWS bedrock bug causing 10x charges
41–50 of 79 posts
Re: Codex on AWS bedrock bug causing 10x charges
#42Sounds like a path to profitability rather than a bug.
Bug ... Feature
Re: Codex on AWS bedrock bug causing 10x charges
#43Sounds like a path to profitability rather than a bug.
Bug for user = feature for company
Re: Codex on AWS bedrock bug causing 10x charges
#44The fact that companies with access to SOTA non-public AI keep having these kinds of dumb bugs in something as simple as a chat app helps validate my disbelief of people claiming AI is ready to replace all software development.
> The fact that companies with access to SOTA non-public AI keep having these kinds of dumb bugs in something as simple as a chat app helps validate my disbelief of people claiming AI is ready to replace all software development. Except leadership doesn't care about dumb bugs. Never has, never will (until it's too late). It cares about velocity and cost. They'd totally replace all software development with worse AI s…
> Except leadership doesn't care about dumb bugs. Never has, never will (until it's too late). It cares about velocity and cost.
This is the very moment at which I started my own business. I prefer to work for myself with some quality standards than to be in a rush in front of a prompt (not that I do not use AI at all, I do, but not for generating code most of the time).
I knew the future, at that time was basically: pressure for speed, taking ownership of course, even if they rush you. Wild-guess, probably with an AI, to add on top more trch debt. Make everything unmaintainable in the long term.
So this was the perfect moment to show that things can be done in another way and quality can be kept higher than the competition bc what I am seeing lately is people throwing things in a rush. Better twopieces of well-crafted software than 10 pieces of unmantainable junk.
Re: Codex on AWS bedrock bug causing 10x charges
#45Codex usage feels exorbitantly high since today. They [0] are denying it, but the number of anecdotal users who decided to raise this as an issue (as a result it's trending on X) says otherwise.
Re: Codex on AWS bedrock bug causing 10x charges
#46[flagged]
Re: Codex on AWS bedrock bug causing 10x charges
#47Wow, that whole thread is borderline incoherent, presumably generated by an AI without adequate oversight. Here are the docs: https://developers.openai.com/api/docs/guides/prompt-caching... The thread has little explanation as to what weird thing they’re doing to Codex that is making the default work poorly, and it kind of seems like it’s getting confused about whether it wants to set the caching mode or the breakpoi…
It’s really cool that we have this proof that US companies are half year behind Chinese models in architecture.
Then why are they (US frontier models) still so far ahead whenever I test them against the latest Chinese models? No bias here, I'd love them to be better for my own personal gain, but I haven't seen it
Re: Codex on AWS bedrock bug causing 10x charges
#48Earlier quoted context omitted.
> It sounds to be like 5.5 and below may have been using a conventional attention scheme where a cached KV sequence can be easily used to restore a prefix of itself, but perhaps 5.6 is using linear attention or LSTM or another recurrent scheme where you cannot rewind the model state by just truncating it. I feel like this is the kind of substantial change to your product that you would need to tell your customers abo…
It depends on who they consider the customers. Shareholders and govt are the customers, not users. Users is the product.
“Users are the product” is a phrase used when the users aren’t the ones paying for a free service. For a paid API the users absolutely are the customers.
Re: Codex on AWS bedrock bug causing 10x charges
#49Prompt edits leaking into the cache and affecting model responses is exactly the kind of billing-relevant behavior change that should be in release notes, not discovered by users.
Re: Codex on AWS bedrock bug causing 10x charges
#50The fact that companies with access to SOTA non-public AI keep having these kinds of dumb bugs in something as simple as a chat app helps validate my disbelief of people claiming AI is ready to replace all software development.
AI is ready to replace both jobs and companies. The companies you see struggling are ripe for disruption.
[dead]