Having a 20GB file that lets you ask an offline computer any question is amazing
1–10 of 127 posts
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#2I was pretty impressed by the power and accuracy of the Google Translate offline models (which predate some of the amazing new LLMs), also in a seemingly amazingly small space—tens of megabytes per language, if I remember correctly?
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#3I feel the same way with running stable diffusion on my MacBook (DiffuseBee app). The idea that I can generate an image of almost anything and it has references to what it means in the real world, and carry that in my backpack, is little hard to comprehend.
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#4The attitude in the comments is amazing. The LLM chatbot hype cycle bears a lot of resemblance to the crypto hype before the crash.
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#5You can download a local version of Wikipedia and yet barely anyone does this. (And I know wikipedia has a ton of problems)
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#6Why would I do something like that?? Every time I ask something to chatGPT I get wrong answers…
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#7My goal: download the entire Wikipedia and store it in a vector db. Then have a local LLM answer questions based on Wikipedia. Best of both worlds!
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#8We can do that, but then we will need to close all applications to run it because it will need 20GB RAM or VRAM to run.
It is still more practical to visit stackoverflow when I have a question.
(still impressive how much this improves every week. Maybe in 2-3 months we have something more useful)
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#9You can download a local version of Wikipedia and yet barely anyone does this. (And I know wikipedia has a ton of problems)
Or an Encyclopedia Britannica on the shelf/in pdf. People don't know that they need it, but it indeed feels amazing when you need an information, and it is there.
Re: Having a 20GB file that lets you ask an offline computer any question is amazing
#10Why would I do something like that?? Every time I ask something to chatGPT I get wrong answers…
[dead]