Live data from Hacker News

Show HN: Graph-based AI for longform writing

jotte.ai

31–40 of 81 posts

Re: Show HN: Graph-based AI for longform writing

#31

Earlier quoted context omitted.

E.g. you can imagine implementing an AI D&D dungeon master this way. It could even trigger things like (AI-synthesized) music at the right time. Or you could build an AI girlfriend/conversation partner.

I don't understand exactly how that would work. At some point, the generation would introduce new events and characters, new places or objects, and name them, but then when summarising, won't the names of some of them be lost, just because there's not enough space in the summary to name them all? The same goes for all sorts of detail, not necessarily named. At that point, what happens to the narrative about those for…

[deleted]

Re: Show HN: Graph-based AI for longform writing

#32

What exactly is the use case for "longform writing by AI"? Profiting from mass-produced zero-effort novels?

I see zero problem with that. If great literary works can be produced with a click of a button we should do it. And if they’re not great then they’re not great - we’re already more than capable of producing not great novels.

Re: Show HN: Graph-based AI for longform writing

#33

What exactly is the use case for "longform writing by AI"? Profiting from mass-produced zero-effort novels?

I see zero problem with that. If great literary works can be produced with a click of a button we should do it. And if they’re not great then they’re not great - we’re already more than capable of producing not great novels.

If they're universally bad though, they will flood the world with crap and make it very difficult to find the great (i.e. human-written) literary works.

Re: Show HN: Graph-based AI for longform writing

#34

What exactly is the use case for "longform writing by AI"? Profiting from mass-produced zero-effort novels?

I see zero problem with that. If great literary works can be produced with a click of a button we should do it. And if they’re not great then they’re not great - we’re already more than capable of producing not great novels.

> And if they’re not great then they’re not great

You see no problem with flooding every market with junk products that cost nothing to produce so that non-junk products are crowded out and impossible to find? This is exactly the thing that everyone now hates Amazon for and why trying to find honest reviews of anything online is so horribly frustrating.

Some barrier to entry is always better than no barrier to entry.

Re: Show HN: Graph-based AI for longform writing

#36

Earlier quoted context omitted.

I see zero problem with that. If great literary works can be produced with a click of a button we should do it. And if they’re not great then they’re not great - we’re already more than capable of producing not great novels.

> And if they’re not great then they’re not great You see no problem with flooding every market with junk products that cost nothing to produce so that non-junk products are crowded out and impossible to find? This is exactly the thing that everyone now hates Amazon for and why trying to find honest reviews of anything online is so horribly frustrating. Some barrier to entry is always better than no barrier to entry.

On the other hand, it could give nonprofit, noncommercial hosts an unprecedented advantage since there is less incentive to spam there.

Re: Show HN: Graph-based AI for longform writing

#38
post #2

I am glad to see more stuff with graph based AI here. I have a running bet with a friend about whether future is going to be OBM (One Big Model) or LoLM (Lots of Little Models). I'm strongly in the LoLM/graph camp and have been working in that direction as well: https://github.com/Miserlou/Helix

I've done some work with graph neural nets as well as text NNs.

I think we've repeatably seen that models which replace an end-to-end system with a single model work amazingly well when there is sufficient data to train the whole system.

But there are often practical reasons why a non-end-to-end system are easier to build as an intermediate step.

Re: Show HN: Graph-based AI for longform writing

#39
post #4
post #2

I am glad to see more stuff with graph based AI here. I have a running bet with a friend about whether future is going to be OBM (One Big Model) or LoLM (Lots of Little Models). I'm strongly in the LoLM/graph camp and have been working in that direction as well: https://github.com/Miserlou/Helix

Yeah I feel like for development, OBM is great and super flexible. But when you actually want to deploy, a lot of tiny, more efficient models would probably be the best bet. I read somewhere that the a company ended up fine-tuning FLAN-T5 instead of going GPT-3, which I can imagine saved them lots of $$.

FLAN-T5 is a very capable model for anything that is non-generative.
Post reply on HN