I'm curious for someone like Ilya does he use LLM for daily brainstorming ?
LLMs are not suitable for brainstorming
51–60 of 99 posts
Re: LLMs are not suitable for brainstorming
#52Earlier quoted context omitted.
I just used your prompt on GPT 4o appended with "Be brutally honest, if the idea is bad, feel free to let me know without any sugarcoating" as sibling comments have suggested, and it works pretty well and doesn't give false platitudes.
Nice, will start using that. … it is still a little weird that the default is, like, psychotic levels of positivity, though.
The creators of these LLMs train it not to offend, to an extreme degree, so much so that it sounds unnatural to humans.
Re: LLMs are not suitable for brainstorming
#53I find LLMs to be useful tools for brainstorming. I have often inadvertently found myself brainstorming just by explaining something challenging I am working on to a colleague with no expertise in my area. Just explaining forces new perspectives and new ideas. Similarly, LLMs are captive audiences for throwing out ideas and playing with them. The interaction creates something more than just talking to myself or a whi…
I agree with this, but also get so irritated with the endless praise. Like, tell me I'm wrong and tell me why. If I present a bad idea, tell me that. Or even like "huh? explain" Looking forward to ramping up the honesty parameter. Hoping OpenAI's new voice model trivializes this so I don't need to prompt engineer.
That's a truly innovative approach! This will create a robust solution to that problem.
Re: LLMs are not suitable for brainstorming
#54> The reason [LLMs are not a good tool to do truly effective brainstorming] is LLMs are trained to follow existing patterns in the human-produced corpus, and not natively taught to “brainstorm”. The problem with this argument is that people do the same thing, we’re not that great at brainstorming either. When we brainstorm in groups, we’re just bringing multiple points of view together. The more data LLMs are trained…
We don't need more data, we need independent LLMs with slight randomness.
Aren’t independent LLMs just more data? Some AI researchers are arguing that more data is the primary thing that got us this far, and the primary thing that will improve AI from here. Here’s an example (and a very good talk whether you believe my summary) https://www.youtube.com/live/a13aqr07tJ4?si=FZO5m_XzrfpDhyQP
As a part-time generative artist for several decades, a user of Monte-Carlo methods on a daily basis, and author of some papers on the topic, I personally believe that randomness is not a good answer to anything creative. Randomness is boring, and average. Randomness only helps you when you have a high quality Markov model constraining what your RNG chooses between, and that’s more or less all LLMs actually are. Adding more randomness to creative works in general makes creative works muddy and lowers quality, it needs to be guided. Randomness is a useful tool, but is widely misunderstood IMO and not very effective at brainstorming style exploration; brainstorming is about solving problems in interesting ways, i.e., there is reasoning behind it, not slightly more random word salad.
Re: LLMs are not suitable for brainstorming
#55Earlier quoted context omitted.
I agree with this, but also get so irritated with the endless praise. Like, tell me I'm wrong and tell me why. If I present a bad idea, tell me that. Or even like "huh? explain" Looking forward to ramping up the honesty parameter. Hoping OpenAI's new voice model trivializes this so I don't need to prompt engineer.
Me: “I’d like to start a business harvesting cat shit to fight global warming. People would pay me to take their cat shit and bury it because maybe it has carbon in it or something IDK I’m not a scientist. I would give them carbon credits in the form of a cat-shit-sequestration crypto token my business created. I’d pick up the cat shit by bicycle to save carbon emissions. Please help me develop a business plan.” Char…
Tried putting that verbatim into Phind, got back an essay on how to get funding to start a business. In the conclusion was this gem: "While the idea of harvesting cat feces for carbon sequestration is innovative, success will depend on thorough research, strategic planning, and effective execution."
Re: LLMs are not suitable for brainstorming
#56LLMs seem to be unsuitable for a lot of work.
Re: LLMs are not suitable for brainstorming
#57Earlier quoted context omitted.
Nothing is really original. That's why you can make finite lists of the possible plots of books and movies. It's why TVtropes is a thing. Everything is just a mashup of things before.
i really suggest digging deeper than Netflix or HBO before making such a claim
Science is moving faster than ever and this dude is really like "people don't ever invent anything new actually"
Re: LLMs are not suitable for brainstorming
#58> LLMs won’t behave in a more creative and independent way (as we hoped), but more susceptible to issues like hallucination. What is creativity if not what people call hallucination? Horribly named phenomenon, btw.
I tried asking an LLM for assistance with Chef Policyfiles today (more specific than that of course), and the response was as if it was for a non-existent product rather than Chef. It even included a code block that it claimed I could run on repl.it if I had an account, which resembled a resource block in chef (policies are not a kind of resource).
If a coworker confidently gave me code that is not only wrong, but relies on things that don't exist, I wouldn't call it creative. If they tried to claim that no I'm wrong, it is real, I might even say they hallucinated it.
Re: LLMs are not suitable for brainstorming
#59Secret prompt - add 'using TRIZ methodology' to your brainstorming prompts
Never heard of TRIZ before and am now falling down a great rabbit hole. Thanks!
Re: LLMs are not suitable for brainstorming
#60Earlier quoted context omitted.
Nothing is really original. That's why you can make finite lists of the possible plots of books and movies. It's why TVtropes is a thing. Everything is just a mashup of things before.
Ah, yes, Everything that can be invented has been invented. - apocryphally attributed to Charles H. Duell, Commissioner of US Patent Office way back in 1889. This is a myth. Just because you don't really see blinding insight every day doesn't mean it doesn't exist (and it's more spectacular when you do see it!) Another reason that this seems to happen is that innovation and invention tend to happen in more esoteric a…
Even Charles Duell wasn't speaking originally here:
"What has been will be again, what has been done will be done again; there is nothing new under the sun."
- Ecclesiastes 1:9 (circa 250 BC)