Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Storm: LLM system that researches a topic and generates full-length wiki article

github.com

Post reply on HN
Print view View original

81–90 of 104 posts

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#81

Post by skywhopper »

tossandthrow wrote: post #3
Logans_Run wrote: post #2

Oh dear lord .... sub heading states - Storm - Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models Good luck with this storm, wiki's the world over. Just a thought but ... maybe someone should ask an org like the Internet Archive to snap-shot Wikipedia asap and label it Pre-Storm and After-Storm

there is this sentiment of Ai induced deterioration and pollution. what if that is not the case? what if the quality of this type of content actually increases?

How could it? LLMs hallucinate false information. Even if hallucinations are improved, the false information they've generated is now part of the body of text they will be trained on.

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#82

Post by [deleted] »

_akhe wrote: post #62
manishsharan wrote: post #24

At what point will it be just LLM Bots arguing with Other LLM Bots on Wikepedia edits ?

As long as the LLM Moderator deems it safe discourse let the best idea win! I'd love a debate between 2 highly-accurate and context-aware LLMs - if such a thing existed. Otherwise it would be like reading HN or Reddit debates where 2 egomaniacs who are both wrong continually straw man each other with statements peppered with lies and parroted disinfo, aint got time for that.

[deleted]

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#83

Post by __loam »

visarga wrote: post #70
lukev wrote: post #27

I can see this being useful iif the content is generated on demand and then discarded. Publishing AI generated material is generally speaking a horrible idea and does nobody any good (at least until accuracy levels get much much better.) Even if they do it well and truthfully (which they don't) current LLMs can only summarize, digest, and restate. There is no non-transient value add. LLMs may have a place to help que…

> current LLMs can only summarize, digest, and restate. There is no non-transient value add. No, you're wrong. LLMs create new experiences after deployment, either by assisting humans, or by solving tasks they can validate, such as code or game play. In fact any deployed LLM gets to be embedded in a larger system - a chat room, a code running environment, a game, a simulation, a robot or inside a company - it can lea…

https://twitter.com/itsandrewgao/status/1689634145717379074?...

Yeah this is really having a positive impact on scientific discovery.

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#84

Post by schainks »

LeoPanthera wrote: post #4

I saved a full snapshot of Wikipedia (and Stack Overflow) in the weeks before ChatGPT launched, and every day I'm more glad that I did. They will become the Low Background Steel of text.

How do you browse this snapshot? I'm interested in this solution, too

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#85

Post by [deleted] »

observationist wrote: post #78
lukev wrote: post #27

I can see this being useful iif the content is generated on demand and then discarded. Publishing AI generated material is generally speaking a horrible idea and does nobody any good (at least until accuracy levels get much much better.) Even if they do it well and truthfully (which they don't) current LLMs can only summarize, digest, and restate. There is no non-transient value add. LLMs may have a place to help que…

This is categorically untrue. Publishing material generated like this is going to be generally better than human generated content. It takes less time, can be systematically tested and rigorous, and you can specifically avoid the pitfalls of bias and prejudice. A system like this is multilayered, with prompts going through the whole problem solving process, considering the information presented, assuring quality and…

[deleted]

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#86

Post by cyanydeez »

CuriouslyC wrote: post #63
lukev wrote: post #27

I can see this being useful iif the content is generated on demand and then discarded. Publishing AI generated material is generally speaking a horrible idea and does nobody any good (at least until accuracy levels get much much better.) Even if they do it well and truthfully (which they don't) current LLMs can only summarize, digest, and restate. There is no non-transient value add. LLMs may have a place to help que…

I think bootstrapping documentation with LLM output is a great practice. It's a wiki, people can update it from a baseline, just as long as they can see what was LLM generated to know that it shouldn't be taken as absolute truth. The hardest part of good documentation is getting started. Once there are docs in place it's usually much easier to revise and correct than it would have been to write correctly by hand the…

Unfottunately youre just setting the stage gor subtling incorrect data

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#87

Post by pksebben »

tossandthrow wrote: post #72
pksebben wrote: post #56

Earlier quoted context omitted.

I'm not sure I follow you - reason for what? To be clear - I'm with you that these systems can absolutely be a force for vast good (at least, I think that was what you were getting at unless there was a missing '/s'). I use them daily to pretty astounding effect. I'll admit to being a little put off by being labeled dogmatic - it's not something I consider myself to be.

it was a half sentence, for that I apologize. and I don't remember entirely what I meant. However, I do see a lot of one-sentence "truthms" being thrown around. like "garbage in; garbage out" and the likest. these are not correct. we can just look at the current state of the art with LLMs that has vast amounts of garbage going in - it seems like the value is in the vastness of the data over the quality. > On the one…

Ah, I see. What I meant by that was, "A tool is as good or evil as the person wielding it".

There are most definitely good and bad tools, in terms of more or less effective. Machine learning models are for sure outclassing a whole swath of tools in a number of domains and will more than likely continue to overtake purposes over time.

Whether this is a good thing for society is what I thought we were questioning - which is what I meant by steering. We can build tooling to do things like establish veracity, enable interrogation of models, and provide reasoning about internals (which we should do).

Open sourcing as much of this effort as possible will further lead to Good Things (because why are people working on these for free if they're not creating something of actual use) - whilst leaving all ML development to large corporations will inevitably ensure that the only thing you can trust an ML model to do would be spy on you and try to get you to buy stuff, because money.

God the grammar in that last sentence was terrible. But I think you get the point.

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#88

Post by lazyasciiart »

groceryheist wrote: post #12
jakderrida wrote: post #8

Earlier quoted context omitted.

The thing is that the Wiki mods will need to be more diligent with uncited things. I also see 2 massive opportunities here. First is that they can have agents check the cited source and verify whether the source backs up what's said to a reasonable degree. Second opportunity is fitting in things only found in other language Wikis that either be incorporated into the english one or help introduce new articles. Believe…

> First is that they can have agents check the cited source and verify whether the source backs up what's said to a reasonable degree. This is a hard and tmk unsolved NLP/IR problem, and data access is an issue. > Second opportunity is fitting in things only found in other language Wikis that either be incorporated into the english one or help introduce new articles. This has been attempted via machine translation in…

I speak multiple languages. It'd be fun to be given a link saying "this article has content present that is not in the English version" and see if I can update either of the articles using what's in the other copy. But I'm not going to go read wikipedia articles in two languages to find them.

Re: Storm: LLM system that researches a topic and generates full-length wiki article

#89

Post by [deleted] »

CuriouslyC wrote: post #63
lukev wrote: post #27

I can see this being useful iif the content is generated on demand and then discarded. Publishing AI generated material is generally speaking a horrible idea and does nobody any good (at least until accuracy levels get much much better.) Even if they do it well and truthfully (which they don't) current LLMs can only summarize, digest, and restate. There is no non-transient value add. LLMs may have a place to help que…

I think bootstrapping documentation with LLM output is a great practice. It's a wiki, people can update it from a baseline, just as long as they can see what was LLM generated to know that it shouldn't be taken as absolute truth. The hardest part of good documentation is getting started. Once there are docs in place it's usually much easier to revise and correct than it would have been to write correctly by hand the…

[deleted]
Post reply on HN