Is it going to send my personal data to OpenAI? Isn't that a serious problem? Does not sound like a wise thing to do, not at least without redacting all sensitive personal data from the data. Am I missing something?
PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
41–50 of 143 posts
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#42Why have the OpenAI dependency when there's local embeddings models that would be both faster and more accurate?
Which ones?
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#43Am I the only one who doesn't need to search across my data? What are the use cases here
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#44The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
> is that pretty much all of them require OpenAI. They're not here to release an actual product. They're here to release part of a CV proving they have "OpenAI" experience. I'm assuming this is the result of OpenAI not actually having any homegrown certification program of their own.
> OpenAI not actually having any homegrown certification program
A bit off topic but where are certifications (e.g. Cisco, Microsoft) useful? I am sure they are useful (both to candidates and companies) because people go to the effort to get these certs, and if they were useless everyone would have stopped long ago. I don't assume people do it for ego satisfaction.
But I've never worked anywhere where it has come up as an interview criterion (nobody has ever pointed it out when we are looking at a resume, for example). Is it a big business thing? Is it just an HR thing?
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#45Earlier quoted context omitted.
How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.
>Mac Running Intel When running a Mac with Intel hardware (not M1), you may run into clang: error: the clang compiler does not support '-march=native' during pip install. If so set your archflags during pip install. eg: ARCHFLAGS="-arch x86_64" pip3 install -r requirements.txt https://github.com/imartinez/privateGPT#mac-running-intel
I’m curious about the response times though, i imagine they will be quite slow on an intel Mac
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#46Earlier quoted context omitted.
" many of its top proponents have come out and publicly said." You don't have to uncritically accept that, it's far more likely that they're just self aggrandizing in a "wow I'm so smart my inventions can destroy the world, better give me more money and write articles about me to make sure that doesn't happen".
I see, so when it comes to the top experts in AI screaming “we made a mistake, please be careful” we should use nuance and actually conclude the opposite — that we should press ahead and they’re wrong. But with Web3, we should just listen to a bunch of random no-name haters say “there are NO GOOD APPLICATIONS, trust us, period, stop talking about it”, use no nuance or critical thinking of our own, and simply stop bui…
The crypto group had a lot of time and even more money to make a compelling product that took off and so far they've failed. We've watched fraud after fraud as they've shown themselves to just be ignorant and arrogant ideologues who don't understand how the "modern" finance system came to be, what the average user wants out of financial or social products, or just outright scammers. We can keep sinking money into a bottomless pit or we can move on and learn from their mistakes.
I didn't say to dismiss any concerns out of hand, but the whole idea of "x-risk" or "human extinction" from ai is laughable and isn't taken seriously by most people. Again if you think critically about the whole idea of "human extinction" from any of the technology being talked about you should see it as nonsense.
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#47Earlier quoted context omitted.
> is that pretty much all of them require OpenAI. They're not here to release an actual product. They're here to release part of a CV proving they have "OpenAI" experience. I'm assuming this is the result of OpenAI not actually having any homegrown certification program of their own.
> OpenAI not actually having any homegrown certification program A bit off topic but where are certifications (e.g. Cisco, Microsoft) useful? I am sure they are useful (both to candidates and companies) because people go to the effort to get these certs, and if they were useless everyone would have stopped long ago. I don't assume people do it for ego satisfaction. But I've never worked anywhere where it has come up…
I've only ever seen it as a people who don't have a job thing.
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#48The most frustrating thing about the many, many clones of this exact type of idea is that pretty much all of them require OpenAI. Stop doing that. You will have way more users if you make OpenAI (or anything that requires cloud) the 'technically possible but pretty difficult art of hoops to make it happen' option, instead of the other way around. The best way to make these apps IMO is to make them work entirely local…
Gpt4all does exactly that. You can choose between local model or bring your own openai token.
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#49Earlier quoted context omitted.
> is that pretty much all of them require OpenAI. They're not here to release an actual product. They're here to release part of a CV proving they have "OpenAI" experience. I'm assuming this is the result of OpenAI not actually having any homegrown certification program of their own.
> OpenAI not actually having any homegrown certification program A bit off topic but where are certifications (e.g. Cisco, Microsoft) useful? I am sure they are useful (both to candidates and companies) because people go to the effort to get these certs, and if they were useless everyone would have stopped long ago. I don't assume people do it for ego satisfaction. But I've never worked anywhere where it has come up…
Mainly when applying for a corporate job where you have 0 referrals. It's a guidepost that you at least have some idea what you're doing and are worth interviewing when people can't find someone who knows you and your previous work.
Re: PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
#50Don't build a personal ChatGPT, and don't let OpenAI, Microsoft and their business partners (and probably the US government) have a bunch of your personal and private information.
So avoid all Microsoft products too?