PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS

Post by jstummbillig » Sun, Jul 09, 2023, 10:00 AM UTC

xmprt wrote: post #68

jstummbillig wrote: post #29

Earlier quoted context omitted.

What do you (or anyone else, feel free to chime in) do with other LLMs that makes them useable for anything that is not strictly tinkering? Here is my premise: We are past the wonder stage. I want to actually get stuff done efficiently. From what I have tested so far, the only model that allows me to do that halfway reliably is GPT-4. Am I incompetent or are we really just wishfully thinking in HN spirit that other L…

This line of thinking only works if it's impossible to imagine a world where OpenAI isn't the leader. In 2 years if the non OpenAI models are better then it will serve us much better to allow these tools to work with other models as well.

Post by tudorw » Sun, Jul 09, 2023, 10:24 AM UTC

hospitalJail wrote: post #40

chaxor wrote: post #2

The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…

ClosedAI has freaked me out with how much power they have, and how irresponsible they are with it. I'm so horrified that they are going to take away the ability to ask medical questions when the AMA comes knocking at their door.

Post by BeetleB » Sun, Jul 09, 2023, 4:20 PM UTC

theonlybutlet wrote: post #104

BeetleB wrote: post #78

Earlier quoted context omitted.

Example use case: We have a group at work that meets and discusses various investment topics. The guy organizing it is fairly well connected and every week he tries to get an external speaker to come and present. Very educational. I have raw notes for each of these presentations. My goal has always been to go through those notes, and properly organize the knowledge in there into a wiki of sorts. It's been 3 years sin…

You're creating additional hardship for yourself. Why create a pdf only to convert it out of pdf again. Just insert all your notes into the LLM model.

Post by pmichaud » Sun, Jul 09, 2023, 10:23 PM UTC

space_fountain wrote: post #25

trolan wrote: post #22

Earlier quoted context omitted.

The only OpenAI 'crap' being used here is to generate the embeddings. Right now, OpenAI has some of the best and cheapest embeddings possible, especially for personal projects. Once the vectors are created tho, you're completely off the cloud if you so choose. You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes. Everything else is already using huggingface here…

Do you have citations on OpenAI embeddings being some of the cheapest and best? The signs I've seen points almost in the opposite direction?

Post by trolan » Mon, Jul 10, 2023, 1:20 AM UTC

aledalgrande wrote: post #112

trolan wrote: post #22

Earlier quoted context omitted.

The only OpenAI 'crap' being used here is to generate the embeddings. Right now, OpenAI has some of the best and cheapest embeddings possible, especially for personal projects. Once the vectors are created tho, you're completely off the cloud if you so choose. You can always swap out the embedding generator too, because LangChain abstracts that for your exact gripes. Everything else is already using huggingface here…

> Once the vectors are created tho, you're completely off the cloud if you so choose. Ehr no? You'll need to also create an embedding of your query, which makes you totally dependent on OpenAI. If you swap out embedding algorithm you will have to regenerate all the embeddings as well, they might not be even the same size.