Hmm something about this title containing the word 'research' disturbs me. I associate that word with rigorous scientific methods that leads to fact based knowledge or maybe some new hypothesis, not some LLM hallucinating sources, references, quotes and all the other garbage they spit out when challenged over a point of fact. Horrifying to think peeps might turn towards these tools for factual information.
Storm: LLM system that researches a topic and generates full-length wiki article
11–20 of 104 posts
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#12I saved a full snapshot of Wikipedia (and Stack Overflow) in the weeks before ChatGPT launched, and every day I'm more glad that I did. They will become the Low Background Steel of text.
The thing is that the Wiki mods will need to be more diligent with uncited things. I also see 2 massive opportunities here. First is that they can have agents check the cited source and verify whether the source backs up what's said to a reasonable degree. Second opportunity is fitting in things only found in other language Wikis that either be incorporated into the english one or help introduce new articles. Believe…
> First is that they can have agents check the cited source and verify whether the source backs up what's said to a reasonable degree.
This is a hard and tmk unsolved NLP/IR problem, and data access is an issue.
> Second opportunity is fitting in things only found in other language Wikis that either be incorporated into the english one or help introduce new articles.
This has been attempted via machine translation in the past, and it failed because you need native speakers to verify and correct the translations and this wasn't the sort of work that people were jumping to volunteer to do.
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#13Oh dear lord .... sub heading states - Storm - Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models Good luck with this storm, wiki's the world over. Just a thought but ... maybe someone should ask an org like the Internet Archive to snap-shot Wikipedia asap and label it Pre-Storm and After-Storm
there is this sentiment of Ai induced deterioration and pollution. what if that is not the case? what if the quality of this type of content actually increases?
I mean, putting a bullet to someone's head can extirpate a brain tumor they hadn't been alerted to before, while leaving a grateful person owing you kudos. What if?
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#14Nucleo AI Alpha
An AI assistant app that mixes AI features with traditional personal productivity. The AI can work in the background to answer multiple chats, handle tasks, and stream/feed entries.
https://old.reddit.com/r/LocalLLaMA/comments/1b8uvpw/does_fr...
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#15Hmm something about this title containing the word 'research' disturbs me. I associate that word with rigorous scientific methods that leads to fact based knowledge or maybe some new hypothesis, not some LLM hallucinating sources, references, quotes and all the other garbage they spit out when challenged over a point of fact. Horrifying to think peeps might turn towards these tools for factual information.
Yes, I came to the comments to say the same thing. The LLM is not doing research - it is aggregating data associated with terms and reorganizing text based on what previous responses to a similar prompt would look like.
At the most generous level of scrutiny, the only part that could be related to research would be the aggregation of sources - but that is only a precursor to research and likely is too generalized to be as accurate as a specialist preparing data for actual research.
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#16Earlier quoted context omitted.
why not Ai? And even if we accept the premise (as flawed as it might be) that Ai is not able to create original knowledge, most of what's online is dessimination and dies not represent new information but just old information rewritten to be understandable by a certain segment. something LLMs excel at.
> Ai is not able to create original knowledge The current state of LLMs do hallucinate though. It's just not a very trustworthy source of facts.
just like my first teachers said I should absolutely not use Wikipedia.
LLMs was popularized less than 2 years ago.
I think it is safe to assume that it will be as trustworthy as you see Wikipedia today, and probably even more as you can embed reasoning techniques into the LLMs to correct misunderstandings.
Wikipedia cannot self correct.
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#17Hmm something about this title containing the word 'research' disturbs me. I associate that word with rigorous scientific methods that leads to fact based knowledge or maybe some new hypothesis, not some LLM hallucinating sources, references, quotes and all the other garbage they spit out when challenged over a point of fact. Horrifying to think peeps might turn towards these tools for factual information.
This anthropomorphism really bothers me. These tools are useful for what they’re good for, but I really dislike the agency people keep trying to give to them.
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#18Oh dear lord .... sub heading states - Storm - Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models Good luck with this storm, wiki's the world over. Just a thought but ... maybe someone should ask an org like the Internet Archive to snap-shot Wikipedia asap and label it Pre-Storm and After-Storm
[deleted]
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#19I saved a full snapshot of Wikipedia (and Stack Overflow) in the weeks before ChatGPT launched, and every day I'm more glad that I did. They will become the Low Background Steel of text.
Good analogy! There's good reason to believe that web archives "uncontaminated" by LLM output will have some unique value in the future (if not now).
For those wondering about the analogy:
Re: Storm: LLM system that researches a topic and generates full-length wiki article
#20I hope somebody took a snapshot of the entire internet before 2020, that is our only defence against knowledge laundry.
Wreaking havoc on the digital Akashic records.