Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: ChatGPT and Document Parser = Ghost

ghostextension.com

Post reply on HN
Print view View original

11–20 of 53 posts

Re: Show HN: ChatGPT and Document Parser = Ghost

#11

Post by btbuildem »

ilaksh wrote: post #9

5 pages fits in the context window. How exactly do you plan on expanding the limit? Without explanation we have to assume you haven't completely solved your core technical challenges. In my testing the biggest challenges with using for example OpenAI embeddings with cosine similarity or something are A) figuring out the section breaks or right chunk size so that information stays in context and B) retrieving enough c…

Same, the is lies in the details. You basically need a good semantic search in front of GPT to feed it the best context given the question.

Re: Show HN: ChatGPT and Document Parser = Ghost

#12

Post by nathanwh »

ilaksh wrote: post #9

5 pages fits in the context window. How exactly do you plan on expanding the limit? Without explanation we have to assume you haven't completely solved your core technical challenges. In my testing the biggest challenges with using for example OpenAI embeddings with cosine similarity or something are A) figuring out the section breaks or right chunk size so that information stays in context and B) retrieving enough c…

This explains why "What if I move out early?" for the sample document doesn't mention any of the information in the lease break section, which is definitely the most important section for moving out early. Whatever space they're projecting the question into doesn't capture that "lease break" and "moving out early" are synonyms.

Re: Show HN: ChatGPT and Document Parser = Ghost

#14

Post by ilaksh »

nathanwh wrote: post #12
ilaksh wrote: post #9

5 pages fits in the context window. How exactly do you plan on expanding the limit? Without explanation we have to assume you haven't completely solved your core technical challenges. In my testing the biggest challenges with using for example OpenAI embeddings with cosine similarity or something are A) figuring out the section breaks or right chunk size so that information stays in context and B) retrieving enough c…

This explains why "What if I move out early?" for the sample document doesn't mention any of the information in the lease break section, which is definitely the most important section for moving out early. Whatever space they're projecting the question into doesn't capture that "lease break" and "moving out early" are synonyms.

It may only be retrieving the top N results with most similar embedding. If that answer is in the 3rd most similar chunk and it only fed 2 along with the query in the prompt, then GPT never got the information relevant to the question.

Re: Show HN: ChatGPT and Document Parser = Ghost

#15

Post by satvikpendem »

Ghost is a well known blogging platform so you might want to change the name.

This seems similar to ChatPDF.com (with a 200 page limit though, instead of the 5 page limit that you have, it seems) which I suppose we'll see a lot more competitors for as the ChatGPT API expands.

Re: Show HN: ChatGPT and Document Parser = Ghost

#16

Post by JadoJodo »

(This critique is unrelated to this project. It works as expected, OP, and looks good.)

How could one ever trust the output of ChatGPT?

This feels to me a bit like non-L5 autonomous driving: If I have to assist at all, it'd be easier to do it myself. In the same vein, for this project (and ChatGPT generally): Can I actually trust that the output from ChatGPT in answering my question about the document is factually correct?

e.g., If I hand it a home rental agreement legal document and ask "What is the late move out penalty if I am 10-minutes late in dropping off the keys?", it may give the correct answer. Or it may generate a plausible-sounding answer using the words in the document that is completely (or perhaps even just slightly) incorrect.

How could I possibly know without reading it myself?

Re: Show HN: ChatGPT and Document Parser = Ghost

#17

Post by aver4geredditor »

Ostatnigrosh wrote: post #10
aver4geredditor wrote: post #2

I didn't do any extensive testing but seems to be really useful. However, where can we see the privacy policy? People are probably going to upload some important and confidential documents so it's good to know how this data is being handled. The only thing I see is an asterisk after the 24 hour notice Also, the bot answer window may have 5 pages even if 1 page is enough for the answer, this may confise your users sin…

Hey! This is a great point. So we delete the documents within 24 hours of upload, and have a limitation to 5 pages to cut our own costs as this is just a concept.

Could you please add a more detailed policy to your site? For example, who can see, use or access the uploaded documents in any other way and whether the documents are used to gather some data, analyze or sell it?

Re: Show HN: ChatGPT and Document Parser = Ghost

#18

Post by thewataccount »

This is not meant to be a critique just an open question to everyone trying it - does anyone find this to be more useful then just ctrl+f?

For compiling information or getting an immediate yes/no it's likely correct - but I found ctrl+f generally gets me there faster albiet with slightly more reading.

At least in the context of this lease agreement which does have everything well organized and uses carefully chosen keywords already.

Re: Show HN: ChatGPT and Document Parser = Ghost

#19

Post by Ostatnigrosh »

aver4geredditor wrote: post #17
Ostatnigrosh wrote: post #10

Earlier quoted context omitted.

Hey! This is a great point. So we delete the documents within 24 hours of upload, and have a limitation to 5 pages to cut our own costs as this is just a concept.

Could you please add a more detailed policy to your site? For example, who can see, use or access the uploaded documents in any other way and whether the documents are used to gather some data, analyze or sell it?

I will make sure to add more details. In terms of privacy, those files are visible to no-one but yourself, and we delete everything.
Post reply on HN