201–210 of 254 posts
I'm curious if there is measurable value in diversity of thought, and if there's diminishing returns on a single models thought pattern. For example, compute X tokens with model A, then feed those into model B, etc. to get chain of thought through a diverse set of mdoels rather than chain of thought through a heterogeneous chain. Humans seem to strongly believe echo chambers are bad. Are LLMs the same?
Earlier quoted context omitted.
You can bet that most people on those plans do not tokenmax.
I'll bet the other way: the plan is not cost effective unless you are coding, and even the most junior developer, so green they almost need mowing, are going to throw the agents into a loop. I can not imagine some shelling out $200/month and then using that product lightly.
The people paying for the plan are not the same people using it.
Of 6 people I have data on the $200/plan only 2 regularly use more than $400 value.
> I'll bet the other way: the plan is not cost effective unless you are coding
The person I've personally seen use the most tokens isn't a coder. They do the "second brain" thing and wow it uses a lot of tokens.
They believe in the value, and TBH I've seen them do some pretty interesting and impressive things with it.
> the most junior developer, so green they almost need mowing, are going to throw the agents into a loop
I think this is also true.
But loops actually hit the cache a lot and most people who are calculating the value they are getting from a subscription aren't taking this into account.
SemiAnalysis published a snippet of their analysis, and they believe their tokens are an effective price of $0.99/million, rather than $20/million the naive pricing calculation would give you.
A "Message Echo" textbox that makes it look like you can get a response to a prompt without logging in, only to redirect to the sign-up page. Such a classic dark pattern - and such a sure way to get me to leave your site immediately. I've literally taken one step on your website - the one your site design invited me to take - and immediately got tripped up. I'm not coming back.
I dont know, it's something I can understand as someone also building AI stuff
Earlier quoted context omitted.
The evaluator is public here: https://echo.tracerml.ai/eval/ It currently exposes 907 stored rows across seven benchmark families, with prompts, outputs, grades, and cost records. More benchmarks are coming soon. Echo does not disclose its per-request routing decision because that policy is the product. We can, however, publish some of the eligible open-weight model pool, version dates, aggregate allocation mix, and…
> Echo does not disclose its per-request routing decision because that policy is the product My honest advice: that's going to pull away a decent amount of potential customers, even though I think your idea/concept is fantastic. For example, if we were to consider it for Canva, observerability and full transparency is critical requirement; we can't accept not knowing which model serves a request. Both for legal/contr…
A "Message Echo" textbox that makes it look like you can get a response to a prompt without logging in, only to redirect to the sign-up page. Such a classic dark pattern - and such a sure way to get me to leave your site immediately. I've literally taken one step on your website - the one your site design invited me to take - and immediately got tripped up. I'm not coming back.
On the other hand, the creator would need to pay for those initial queries. This also invites for misues that sum up to large bill for the creator. I dont know, it's something I can understand as someone also building AI stuff
Earlier quoted context omitted.
I burned though my weekly fable usage last night on the $200 plan. I had $200 in promotional usage credits and was in the middle of executing a moderate sized coding plan. Ran on usage credits for about 1h 15m and burned $120 in usage credits. I was astounded to see how fast the $ usage added up. One problem was that I was using sub-agent execution so multiple agents were running simultaneously and I realized at the…
I stopped using sub agents after they caused me to hit my limit to quickly. Had to create a separate account and pay for another max plan to unblock myself temporarily
> Fable-level results at 1/3 the cost I am guessing this is not targeting those of us on the heavily subsidized $200/mo plans. Sure, these plans may be temporary, but none of us really know how temporary they are. Until then, 1/3rd of the published API pricing is not very appealing.
I burned though my weekly fable usage last night on the $200 plan. I had $200 in promotional usage credits and was in the middle of executing a moderate sized coding plan. Ran on usage credits for about 1h 15m and burned $120 in usage credits. I was astounded to see how fast the $ usage added up. One problem was that I was using sub-agent execution so multiple agents were running simultaneously and I realized at the…
And it was damn cheap too! The main page cost was like 5 dollar.
A "Message Echo" textbox that makes it look like you can get a response to a prompt without logging in, only to redirect to the sign-up page. Such a classic dark pattern - and such a sure way to get me to leave your site immediately. I've literally taken one step on your website - the one your site design invited me to take - and immediately got tripped up. I'm not coming back.
A "Message Echo" textbox that makes it look like you can get a response to a prompt without logging in, only to redirect to the sign-up page. Such a classic dark pattern - and such a sure way to get me to leave your site immediately. I've literally taken one step on your website - the one your site design invited me to take - and immediately got tripped up. I'm not coming back.
On the other hand, the creator would need to pay for those initial queries. This also invites for misues that sum up to large bill for the creator. I dont know, it's something I can understand as someone also building AI stuff
A "Message Echo" textbox that makes it look like you can get a response to a prompt without logging in, only to redirect to the sign-up page. Such a classic dark pattern - and such a sure way to get me to leave your site immediately. I've literally taken one step on your website - the one your site design invited me to take - and immediately got tripped up. I'm not coming back.
On the other hand, the creator would need to pay for those initial queries. This also invites for misues that sum up to large bill for the creator. I dont know, it's something I can understand as someone also building AI stuff
This dark pattern is reminiscent of those online test sites in the 2000's where you spend 10 minutes filling out some quiz, then get prompted for an email address to see the results.
https://chat.mistral.ai/chat MoonshotAI had this fake chat box dark pattern.
So I signed up with Mistral instead.