Earlier quoted context omitted.
Eh, it's not __that__ simple.
It is, just don’t use a thing with no soul like ai if soul is what you’re after.
[dead]
Semantic ablation: Why AI writing is generic and boring
71–80 of 234 posts
Re: Semantic ablation: Why AI writing is generic and boring
#72[dead]
People haven't really spoken about the obvious token manipulation that will be on the horizon once any model producer has some semblance of lock-in.
If you thought Google's degredation of search quality was strategic manipulation, wait till you see what they do with tokens.
Re: Semantic ablation: Why AI writing is generic and boring
#73Couldn't you simply increase the temperature of the model to somewhat mitigate this effect?
I kind of think of that as just increasing the standard deviation. Its been a while since I experimented with this, but I remember trying a temp of 1 and the output was gibberish, like base64 gibberish. So something like 0.5 doesn't necessarily seem to solve this problem, it just flattens the distribution and makes the output less coherent, with rarer tokens, but still the same underlying distribution.
Re: Semantic ablation: Why AI writing is generic and boring
#74Nonsense. I’ve written bland prose for a story and AI made it much better by revising it with a prompt such as this: “Make the vocabulary and grammar more sophisticated and add in interesting metaphors. Rewrite it in the style of a successful literary author.” Etc.
[dead]
The great promise and the great disaster of LLMs is that for any topic on which we are "below average", the bland, average output seems to be a great improvement.
Re: Semantic ablation: Why AI writing is generic and boring
#75I personally think “generative AI” is a misnomer. More I understand the mathematics behind machine learning more I am convinced that it should not be used to generate text, images or anything that is meant for people to consume, even if it is the most blandest of email. Sometimes you might get lucky, but most of the time you only get what the most boring person in the most boring cocktail party would say if forced to…
People want the real thing, not artificially flavored tokens.
I would rather read the prompt than the generative output, even if it’s just disjointed words and sentence fragments.
Re: Semantic ablation: Why AI writing is generic and boring
#76[dead]
In recent months(?) I've more often noticed HN story titles changing over time.
I'm not sure what's driving this. It reminds me of SEO.
Re: Semantic ablation: Why AI writing is generic and boring
#77Earlier quoted context omitted.
[dead]
The great promise and the great disaster of LLMs is that for any topic on which we are "below average", the bland, average output seems to be a great improvement.
Counter intuitively... this is a disaster.
We dont need more average stuff - below average output serves as a proxy for one to direct their resources towards producing output of higher-value.
Re: Semantic ablation: Why AI writing is generic and boring
#78As someone longtime involved in software development, can we call this "best practices" instead of some like "semantic ablation" that nobody understands?
[dead]