81–90 of 127 posts
We can do that, but then we will need to close all applications to run it because it will need 20GB RAM or VRAM to run. It is still more practical to visit stackoverflow when I have a question. (still impressive how much this improves every week. Maybe in 2-3 months we have something more useful)
You can download a local version of Wikipedia and yet barely anyone does this. (And I know wikipedia has a ton of problems)
Wikipedia is static, a local AI can be customized and adapted to your needs. For example I would love an AI that could filter, summarize and prioritize news that I'm interested in.
I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…
I also don’t want my AI in the cloud favoring a corporation’s values and goals. But these tools are almost certainly going to come from them. And they want you to store all your data in the cloud too. And they want to keep you from running the software you want.
This process will take time, but if we don't have the equivalent of chatGPT available on a home system (if not phone sized device) in 20 years, I'll eat my hat. There are already open source projects on Github that'll let you roll your own, but good luck coming up with the computing power.
Learning is going to be revolutionized.
Yes, this. Once they get a smidge better and can answer questions? Every student will have the King's Tutor - it will be Blooms Two Sigma in action. ...which will drive down the cost of all knowledge work and rather than reconfigure our society we'll simply have no entry level jobs anymore and the few people who still have jobs will still be expected to work full time but have insane outputs. This whole thing is a Mo…
I expect self-employment to skyrocket.
Earlier quoted context omitted.
I think there is one company very well placed to do this, Apple. Their revenue is driven by hardware sales, rather than advertising, and they have committed to some level of "privacy" focussed design (although obviously there are criticisms). On top of that their hardware is looking almost like it was design for exactly these use cases. Apple silicone with its unified memory architecture, GPU and Neural cores is very…
> Apple have a history of doing stuff locally, on the hardware they designed, that other companies have offloaded to the cloud. Looking at how they promote using iCloud on iDevices, I doubt that.
I was pretty impressed by the power and accuracy of the Google Translate offline models (which predate some of the amazing new LLMs), also in a seemingly amazingly small space—tens of megabytes per language, if I remember correctly?
We can do that, but then we will need to close all applications to run it because it will need 20GB RAM or VRAM to run. It is still more practical to visit stackoverflow when I have a question. (still impressive how much this improves every week. Maybe in 2-3 months we have something more useful)
The magic of swap means you can leave those applications open and as long as they're idle they'll just quietly wait for you on disk until you've finished your LLM adventure.
I know this because I spent this weekend debugging crashes in an LLM pipeline :(
I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…
Earlier quoted context omitted.
what? since when wikipedia is biased? and about what? (and why EB isn't?)
US politics, definitely. But also any other topic that attracts an internet mob large enough to infiltrate the editor community. Take the first few paragraphs of Donald Trump [0] vs. Joe Biden [1] and try to compare the way they're presented: Donald John Trump [...] and his businesses have been involved in more than 4,000 state and federal legal actions, including six business bankruptcies. Trump promoted conspiracy…
The other guy mostly eats ice cream and hangs out in delaware... They tried investigating him already a few times and his son and came up empty handed. Maybe time will prove he's not the best guy ever, but it's pretty safe to say the other guy should be in jail because he's a prolific criminal.