Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Turning books into chatbots with GPT-3

konjer.xyz

Post reply on HN
Print view View original

41–50 of 179 posts

Re: Show HN: Turning books into chatbots with GPT-3

#41

Post by jrochkind1 »

_justinfunk wrote: post #2

I wonder why the books are all non-fiction. I could imagine it would be entertaining to chat with large works of fiction.

Where The Red Fern Grows is there; I too was curious to explore it with fiction, and found that one in the list.

I'd be interested in more fiction too.

Hmmm... Lord of The Rings would be very interesting, for having uses more like "non-fiction" too, people interested in finding various "facts" from it's universe. Or how about not just LOTR, but put in all the works of relevant Tolkien: Hobbit, LOTR, Silmarillion, etc, in the same GPT. Wow, people would actually be pretty crazy for that.

Re: Show HN: Turning books into chatbots with GPT-3

#43

Post by jrochkind1 »

This is really interesting and neat, and also is, I think, a use of GPT-3 that seems, unfortunately, almost optimized for losing a USA copyright claim by the owners of the original source material.

If I were OP, I wouldn't sell these, removing the 'buy' button would up your chances slightly.

But seriously, this is a really cool use of GPT-3.

Re: Show HN: Turning books into chatbots with GPT-3

#44

Post by mnkm »

lgas wrote: post #40
gamegoblin wrote: post #16

Earlier quoted context omitted.

Books that operate in a narrative/temporal style are hard to manage, because statements of fact are mutative. Consider the story: "Justin is hungry. Justin eats dinner. Justin is not hungry." You ask the chatbot "Is Justin hungry?". There is a temporal aspect to this question that is hard for simple systems that are just embedding facts into a vector DB (or similar techniques) to reconcile.

I asked ChatGPT: Me: Consider the story: "Justin is hungry. Justin eats dinner. Justin is not hungry." Is Justin hungry? ChatGPT: No, Justin is not hungry after eating dinner. I'm not sure that it's that big of a problem.

It has more to do with people's expectations of fiction books being different for this format.

With non-fiction it's more straight forward. Simple Q&A.

Re: Show HN: Turning books into chatbots with GPT-3

#46

Post by gamegoblin »

lgas wrote: post #40
gamegoblin wrote: post #16

Earlier quoted context omitted.

Books that operate in a narrative/temporal style are hard to manage, because statements of fact are mutative. Consider the story: "Justin is hungry. Justin eats dinner. Justin is not hungry." You ask the chatbot "Is Justin hungry?". There is a temporal aspect to this question that is hard for simple systems that are just embedding facts into a vector DB (or similar techniques) to reconcile.

I asked ChatGPT: Me: Consider the story: "Justin is hungry. Justin eats dinner. Justin is not hungry." Is Justin hungry? ChatGPT: No, Justin is not hungry after eating dinner. I'm not sure that it's that big of a problem.

The example was to just illustrate the general problem. Think of ingesting a whole novel that takes place over a few years. The whole novel doesn't fit into GPT's context window (which is only a page or two of text). So you have to extract individual statements of fact and index over them (e.g. with semantic indexing, or many other techniques).

It's tricky to deal with cases where the state of something changes many times over the course of the years in the novel.

Imagine you ingest the whole Harry Potter series. You ask the chatbot "How old is Harry Potter?". The answer to the question depends on which part of the story you are talking about. "Does Harry know the foobaricus spell?" The answer depends on which part of the story you are talking about.

Whereas for a non-fiction book typically does not contain these temporally changing aspects. In a book about astronomy, Mars is the 4th planet from the sun in chapter 1, and in chapter 10.

Re: Show HN: Turning books into chatbots with GPT-3

#47

Post by mnkm »

mahathu wrote: post #39
anthropodie wrote: post #8

This is one application of AI that I absolutely like. Imagine in future the AI will be able to ingest any video, blog, books, manuals, license and whole lot of other things and we will just be able to ask questions to it or get a summary from it. I wonder what will happen to actual content then. Currently YouTube is showing info about most watched section of the clips. It saves so much time! Now imagine that happenin…

How do you know what questions to ask if you haven't read the book

If you click the emoji there are some sample questions for each book.

Re: Show HN: Turning books into chatbots with GPT-3

#48

Post by kreas »

leobg wrote: post #30
TomatoTomato wrote: post #15

How are you getting the book text into gpt3?

You don’t. You cut it into snippets. For those you create embeddings which allow you to rank them by semantic similarity to a query. You then prompt GPT3 with the question plus, say, the three most relevant snippets from the book. The most difficult thing about the process is preventing the model from making stuff up.

This is exactly what I'm working on! My project is taking Zoom conversation, using pyannote for speaker diarisation, whisper for transcription, pinecone.io for semantic search, then feeding that into GPT-3 so we can ask questions about conversation.

For us this is super useful because it's not unusual for our discover sessions to last days and we're all terrible at taking notes.

As a nerd, my brain is already buzzing on ways that I could use this for my groups D&D campaigns.

Re: Show HN: Turning books into chatbots with GPT-3

#49

Post by mnkm »

low_tech_punk wrote: post #24

Could you share your ML architecture? Curious if you did it via fine-tuning or other tricks. It is amazing.

it's closed source but if you're interested i have a free weekly newsletter for the project where i document building it.

https://konjer.beehiiv.com/subscribe

Re: Show HN: Turning books into chatbots with GPT-3

#50

Post by anamexis »

PuppyTailWags wrote: post #20
anthropodie wrote: post #8

This is one application of AI that I absolutely like. Imagine in future the AI will be able to ingest any video, blog, books, manuals, license and whole lot of other things and we will just be able to ask questions to it or get a summary from it. I wonder what will happen to actual content then. Currently YouTube is showing info about most watched section of the clips. It saves so much time! Now imagine that happenin…

Usually I find "most watched" ends up just being the most showy part of a clip, but I'm usually wanting the most informational stuff which isn't the same. E.g. I'm a rock climber and watch videos on technique and safety, but most watched is climbing a route with some pop song in the background. Useless.

One thing it's useful for is skipping past advertising segments.
Post reply on HN