31–40 of 58 posts
Oh great a new model annoncemzzzzzz ZZZZZZZZZ
Not just a model - It's a diffusion model. Instead of Next Token prediction it builds the entire page at once and then denoises it. Kind of mind blowing when you watch it happen.
I tried at it creative writing - and, with thinking off, it was considerably better than Mercury 2 and generally good in fact, not very sloppy. Now with thinking on, it got worse, began hallucinating things; this is something I've noticed with all recent models - enabling reasoning causes hallucinations in creative writing assignments.
Oh great a new model annoncemzzzzzz ZZZZZZZZZ
Not related to the Mercury language: https://mercurylang.org/
I tried at it creative writing - and, with thinking off, it was considerably better than Mercury 2 and generally good in fact, not very sloppy. Now with thinking on, it got worse, began hallucinating things; this is something I've noticed with all recent models - enabling reasoning causes hallucinations in creative writing assignments.
Similar, I've found that on most recent models I've tried, reasoning will cause it to spend quite a lot of time thinking about whether even the most wholesome fictional scenario is something it's allowed to write about, which in turn causes it to start hallucinating details. For creative writing I've found the minimum of thinking is the best way.
I tried at it creative writing - and, with thinking off, it was considerably better than Mercury 2 and generally good in fact, not very sloppy. Now with thinking on, it got worse, began hallucinating things; this is something I've noticed with all recent models - enabling reasoning causes hallucinations in creative writing assignments.
I tried at it creative writing - and, with thinking off, it was considerably better than Mercury 2 and generally good in fact, not very sloppy. Now with thinking on, it got worse, began hallucinating things; this is something I've noticed with all recent models - enabling reasoning causes hallucinations in creative writing assignments.
Could you explain how you define hallucination in the context of creativity? Lack of consistency aside, the two look quite similar to me - or would you consider the existence of orcs and elves in LOTR to be hallucinations, too?
Mostly as you've mentioned, "lack of consistency", which manifests in variety of ways - presence of cellphones in historical settings (I'd call them "global inconsistency") and a character for whatever reason suddenly smoking a cigarette ("local inconsistency") I've never mentioned nor present in the context.