Please do not A/B test my workflow
backnotprop.com
Please do not A/B test my workflow
1–10 of 225 posts
Re: Please do not A/B test my workflow
#2Re: Please do not A/B test my workflow
#3A professional tool is something that provides reliable and replicable results, LLMs offer none of this, and A/B testing is just further proof.
Re: Please do not A/B test my workflow
#4This is really frustrating.
Re: Please do not A/B test my workflow
#5The ToS you agreed to gives Anthropic the right to modify the product at any time to improve it. Did you have your agent explain that to you, or did you assume a $200 subscription meant a frozen product?
Re: Please do not A/B test my workflow
#6A professional tool is something that provides reliable and replicable results, LLMs offer none of this, and A/B testing is just further proof.
I don't get your point. Web tools have been doing A/B feature testing all the time, way before we had LLMs.
Re: Please do not A/B test my workflow
#7The ToS you agreed to gives Anthropic the right to modify the product at any time to improve it. Did you have your agent explain that to you, or did you assume a $200 subscription meant a frozen product?
I understand. Just with AI, I don't think the behavior should change so drastically. Which I understand is paradoxical because we enjoy it when it can 10x or 1000x our workflow. I think responsible AI includes more transparency and capability control.
Re: Please do not A/B test my workflow
#8Is the a b test tired to the installation or the user?
Re: Please do not A/B test my workflow
#9Section 6.b of the Claude Code terms says they can and will change the product offering from time to time, and I imagine that means on a user segment basis rather than any implied guarantee that everyone gets the same thing.
b. Subscription content, features, and services. The content, features, and other services provided as part of your Subscription, and the duration of your Subscription, will be described in the order process. We may change or refresh the content, features, and other services from time to time, and we do not guarantee that any particular piece of content, feature, or other service will always be available through the Services.
It's also worth noting that section 3.3 explicitly disallows decompilation of the app.
To decompile, reverse engineer, disassemble, or otherwise reduce our Services to human-readable form, except when these restrictions are prohibited by applicable law.
Always read the terms. :)
Re: Please do not A/B test my workflow
#10Seems completely unsurprising?