Live data from Hacker News

LLMs are not suitable for brainstorming

piaoyang0.wordpress.com

41–50 of 99 posts

Re: LLMs are not suitable for brainstorming

#42
Strongly disagree - brainstorming isn’t about asking someone to give you creative answers, it’s a team sport about triggering unique thoughts that neither person would have had on their own.

Although I might be biased, I love using AI for brainstorming and started building a tool for it https://youtu.be/t5gfETbUzy0

Re: LLMs are not suitable for brainstorming

#43
post #15

>However, here I would like to argue that (especially in cutting edge scenarios) LLMs are not a good tool to do truly effective brainstorming. Great title, they baited and switched. 95% of the time I don't need effective brainstorming, I need a bunch of ideas, let me pick the best, and move on. If its a real engineering problem, then I need >truly effective brainstorming.

I recently spoke with a cousin about their current project decommissioning an oil and gas platform over the next four years (ie. real engineering (in reverse?)). Their comment was that ChatGPT can't write final reports but it's extremely useful for seeding brainstorming sessions with real human engineers. It can generate a list of health, safety, and environmental concerns related to the project that can be distribut…

Yeah for sure, lists of generalized questions is one of ChatGPTs strongest abilities, in my experience.

Re: LLMs are not suitable for brainstorming

#44

There goes 50+% of my use. "LLMs are no good for [use case X]" often means "I aren't very good at using LLMs for [use case X]". With many powerful tools - violins, say, or carpentry tools - we know that it takes a long time and a lot of learning to achieve competent performance, much less virtuoso performance. Someone who spent ten hours learning the violin and concluded "Violins sound terrible" wouldn't have diagnos…

I think it strongly depends on the model.

I found that og gpt4 is better for brainstorming than gpt4 turbo, which in tern is better than gtp4o.

If you're just using the web based portal you don't get much of a choice which model to use or it's temperature.

Re: LLMs are not suitable for brainstorming

#45
Disagree.

LLM might be mostly bad at it, but that doesn't make them unsuitable. They don't have a career to worry about. They don't care what peers or the boss thinks. Etc.

They can spit out ideas - LOTS of them - that real humans then use as a starting point to carry on with.

For more details see "Co-intelligence" by Ethan Mollick.

Re: LLMs are not suitable for brainstorming

#46

Earlier quoted context omitted.

Me: “I’d like to start a business harvesting cat shit to fight global warming. People would pay me to take their cat shit and bury it because maybe it has carbon in it or something IDK I’m not a scientist. I would give them carbon credits in the form of a cat-shit-sequestration crypto token my business created. I’d pick up the cat shit by bicycle to save carbon emissions. Please help me develop a business plan.” Char…

I just used your prompt on GPT 4o appended with "Be brutally honest, if the idea is bad, feel free to let me know without any sugarcoating" as sibling comments have suggested, and it works pretty well and doesn't give false platitudes.

Nice, will start using that.

… it is still a little weird that the default is, like, psychotic levels of positivity, though.

Re: LLMs are not suitable for brainstorming

#47

Earlier quoted context omitted.

>people do the same thing how do you know?

Nothing is really original. That's why you can make finite lists of the possible plots of books and movies. It's why TVtropes is a thing. Everything is just a mashup of things before.

Ah, yes, Everything that can be invented has been invented. - apocryphally attributed to Charles H. Duell, Commissioner of US Patent Office way back in 1889.

This is a myth. Just because you don't really see blinding insight every day doesn't mean it doesn't exist (and it's more spectacular when you do see it!)

Another reason that this seems to happen is that innovation and invention tend to happen in more esoteric and technical realms today, and so they're only really fully understood by experts in that field.

Re: LLMs are not suitable for brainstorming

#49
post #12

> The reason [LLMs are not a good tool to do truly effective brainstorming] is LLMs are trained to follow existing patterns in the human-produced corpus, and not natively taught to “brainstorm”. The problem with this argument is that people do the same thing, we’re not that great at brainstorming either. When we brainstorm in groups, we’re just bringing multiple points of view together. The more data LLMs are trained…

> people do the same thing

You're right, most people do that, but that's because they haven't trained themselves to be inventors. This is a skill that definitely needs to be developed more, but finding truly creative (and sometimes backwards-seeming) solutions can sometimes mean thinking about problems in a completely different way.

However, all LLM's do this. That's one of the points of the article.

Re: LLMs are not suitable for brainstorming

#50

Earlier quoted context omitted.

>people do the same thing how do you know?

Nothing is really original. That's why you can make finite lists of the possible plots of books and movies. It's why TVtropes is a thing. Everything is just a mashup of things before.

i really suggest digging deeper than Netflix or HBO before making such a claim
Post reply on HN