Live data from Hacker News

ResearchAgent: Iterative Research Idea Generation Using LLMs

arxiv.org

51–60 of 66 posts

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#51

In some fields of research, the amount of literature out there is stupendous, and with little hope of a human reading, much less understanding the whole literature. Its becoming a major problem in some fields, and I think, in some ways, approaches that can combine knowledge algorithmically are needed, perhaps llms.

Traditionally, that's what meta-analyses and published reviews of the literature have been for.

even so.

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#52

Earlier quoted context omitted.

Assume free-associations = hallucinations. Assume hallucinations are exactly what makes LLMs useful and your question can be rephrased as "Can you list some examples where LLMs were useful to you?"

Hallucinations are lies. So not the same thing.

Lies require intent. I can ask a model to lie and it will provide info it knows is inaccurate, and can provide the true statement if requested.

Hallucinations are inaccuracies it doesn't realize are inaccurate.

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#53
post #41

Earlier quoted context omitted.

How do you make sure the participants are well informed? What if an idea suggested by a model turns out to be dangerous to implement, but nobody at the hackathon has quite the relevant experience to notice?

Such as?

rsfern is asking exactly that

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#54
post #11

Earlier quoted context omitted.

If we keep extrapolating eventually GPT will be omniscient. I really can't think of any reason why that wouldn't be the case, given the exponential curve we find ourselves on.

How do you know you're not on a logistic curve? Don't you think costs and the availability of training data might impose some constraints?

The entire universe is training data.

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#56

The ideas aren't the hard part.

Tell that to PhD advisor that took credit for all my work because they were his ideas (at least so he claimed).

Unfortunately the good ones who do not steal credit are few and far between. Current incentives select for this behaviour. Not just in academia, but about everywhere.

Go to any meeting and state the obvious fact that "any idiot can have an idea. Making it happen is the tough part" then watch how the decision makers react

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#57
post #42

Earlier quoted context omitted.

This. Any researcher should, over a lunch, be able to generate more idea than can be tackled in a life time.

The fact that a human expert can also do it doesn't mean the AI isn't valuable. Even if you just consider the monetary aspect, those few API calls would definitely be cheaper than buying the researcher lunch. But the big benefit is being able to generate those ideas immediately and autonomously every time there's new data.

I think what they are saying is that idea generation is not a pain point and not really worth solving. Taking ideas and making them happen... that's the hard part where an artificial agent could come in much more handy

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#58

Earlier quoted context omitted.

Such as?

rsfern is asking exactly that

No, I'm asking for an example of an idea that an LLM might produce that is too dangerous to implement but nobody at the hackathon has the relevant experience to notice. You can shut down any endeavour by imagining boogeymen that aren't actually real.

Re: ResearchAgent: Iterative Research Idea Generation Using LLMs

#59

I've found where LLMs can be useful in this context is around free-associations. Because they don't really "know" about things, they regularly grasp at straws or misconstrue intended meaning. This, along with the volume of language (let's not call it knowledge) result in the LLMs occasionally bringing in a new element which can be useful.

I like thinking of LLMs as "word calculators." Which I think really encapsulates how they aren't "intelligent" as the marketing would have you believe but also show how important the inputs are.
Post reply on HN