Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

github.com

Post reply on HN
Print view View original

31–40 of 143 posts

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#31

Post by 3rdrodeo »

EGreg wrote: post #26
3rdrodeo wrote: post #21

Earlier quoted context omitted.

[flagged]

Oh, not this again. No, it's not a net negative in ALL forms. And if you really were concerned about downsides, AI has a ton more potential downsides than Web3 ever did, including human extinction, as many of its top proponents have come out and publicly said. Nothing even remotely close to that is the case for Web3 at all: https://www.nytimes.com/2023/05/30/technology/ai-threat-warn... https://www.theguardian.com/te…

" many of its top proponents have come out and publicly said." You don't have to uncritically accept that, it's far more likely that they're just self aggrandizing in a "wow I'm so smart my inventions can destroy the world, better give me more money and write articles about me to make sure that doesn't happen".

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#32

Post by EGreg »

3rdrodeo wrote: post #31
EGreg wrote: post #26

Earlier quoted context omitted.

Oh, not this again. No, it's not a net negative in ALL forms. And if you really were concerned about downsides, AI has a ton more potential downsides than Web3 ever did, including human extinction, as many of its top proponents have come out and publicly said. Nothing even remotely close to that is the case for Web3 at all: https://www.nytimes.com/2023/05/30/technology/ai-threat-warn... https://www.theguardian.com/te…

" many of its top proponents have come out and publicly said." You don't have to uncritically accept that, it's far more likely that they're just self aggrandizing in a "wow I'm so smart my inventions can destroy the world, better give me more money and write articles about me to make sure that doesn't happen".

I see, so when it comes to the top experts in AI screaming “we made a mistake, please be careful” we should use nuance and actually conclude the opposite — that we should press ahead and they’re wrong.

But with Web3, we should just listen to a bunch of random no-name haters say “there are NO GOOD APPLICATIONS, trust us, period, stop talking about it”, use no nuance or critical thinking of our own, and simply stop building on Web3.

Do you happen to see the extreme double standard here you’re employing, while trying to get people to see things your way?

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#35

Post by akira2501 »

chaxor wrote: post #2

The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…

> is that pretty much all of them require OpenAI.

They're not here to release an actual product. They're here to release part of a CV proving they have "OpenAI" experience. I'm assuming this is the result of OpenAI not actually having any homegrown certification program of their own.

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#36

Post by mvkel »

zikohh wrote: post #4
chaxor wrote: post #2

The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…

Have you seen PrivateGPT. It's quite good and free.

It's not nearly usable. It's functional in that it spits out a response. Can that response be used for anything useful? No.

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#37

Post by colobas »

space_fountain wrote: post #25
trolan wrote: post #22

Earlier quoted context omitted.

The only OpenAI 'crap' being used here is to generate the embeddings. Right now, OpenAI has some of the best and cheapest embeddings possible, especially for personal projects. Once the vectors are created tho, you're completely off the cloud if you so choose. You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes. Everything else is already using huggingface here…

Do you have citations on OpenAI embeddings being some of the cheapest and best? The signs I've seen points almost in the opposite direction?

Can you elucidate on what those signs are? Thanks in advance

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#38

Post by SecurityNoob »

hi wrote: post #5

Keep your data private and don't leak it to third parties. Use something like privateGPT (32k stars). Not your keys, not your data. "Interact privately with your documents using the power of GPT, 100% privately, no data leaks"[0] [0] https://github.com/imartinez/privateGPT

100% private? Hmm. I think with the amount of paranoia that the folks in power have about local LLM’s, I wouldn’t be in the slightest surprised that the Windows telemetry will be reporting back what people are doing with them. And anyone who thinks otherwise is in my view just absolutely naive beyond hope.

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#39

Post by ben_w »

space_fountain wrote: post #25
trolan wrote: post #22

Earlier quoted context omitted.

The only OpenAI 'crap' being used here is to generate the embeddings. Right now, OpenAI has some of the best and cheapest embeddings possible, especially for personal projects. Once the vectors are created tho, you're completely off the cloud if you so choose. You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes. Everything else is already using huggingface here…

Do you have citations on OpenAI embeddings being some of the cheapest and best? The signs I've seen points almost in the opposite direction?

The only embeddings I currently see listed on https://openai.com/pricing are Ada v2, at $0.1/million tokens.

Even if the alternative is free, how much do you value your time, how long will it take to set up an alternative, and how much use will you get out of it? If you're getting less than a million tokens and it takes half an hour longer to set up, you'd better be a student with zero literally income because that cost of time matches the UN abject poverty level. This is also why it's never been the year of linux on the desktop, and why most businesses still don't use Libre Office and GIMP.

I can't speak for quality; even if I used that API directly, this whole area is changing too fast to really keep up.

Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

#40

Post by hospitalJail »

chaxor wrote: post #2

The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…

ClosedAI has freaked me out with how much power they have, and how irresponsible they are with it.

I'm so horrified that they are going to take away the ability to ask medical questions when the AMA comes knocking at their door.

Post reply on HN