Having a 20GB file that lets you ask an offline computer any question is amazing

Post by MacsHeadroom » Tue, May 23, 2023, 3:50 AM UTC

EVa5I7bHFq9mnYK wrote: post #82

lawn wrote: post #26

Earlier quoted context omitted.

Wikipedia is static, a local AI can be customized and adapted to your needs. For example I would love an AI that could filter, summarize and prioritize news that I'm interested in.

AI doesn't know anything past September 2021. Now who is static?

Post by GeneralMayhem » Tue, May 23, 2023, 4:09 AM UTC

bheadmaster wrote: post #71

GeneralMayhem wrote: post #60

Earlier quoted context omitted.

Your [...] are very convenient, because you skipped over the part in paragraph 3 of Trump's article where they go over some of his main "achievements", which are presented neutrally and some people might consider positive: [Trump] signed the Tax Cuts and Jobs Act of 2017, which cut taxes for individuals and businesses and rescinded the individual health insurance mandate penalty of the Affordable Care Act. He appoint…

> Donald Trump spent his four years in office much like he spent most of his previous business career: lying and committing various forms of fraud. While president, just for variety, he added lying and committing fraud about COVID, and, oh yes, inciting a violent insurrection to overthrow the American government. Interesting that I can't find any reference for such claims in the Wikipedia article. The whole introduct…

Post by fancyfredbot » Tue, May 23, 2023, 8:57 PM UTC

kramerger wrote: post #88

fancyfredbot wrote: post #81

Earlier quoted context omitted.

The magic of swap means you can leave those applications open and as long as they're idle they'll just quietly wait for you on disk until you've finished your LLM adventure.

On many modern systems swap is quite small and not large enough to hold the entire system. For a 32GB machine, Ubuntu recommends 6GB and redhat recommends 6.4GB (20%). In a VM that number is much much lower. Besides, some libraries allocate memory in such way that you get artificial memory spikes in physical memory. I know this because I spent this weekend debugging crashes in an LLM pipeline :(

Post by Aerbil313 » Sat, May 27, 2023, 1:51 AM UTC

MitPitt wrote: post #85

analognoise wrote: post #56

Earlier quoted context omitted.

Yes, this. Once they get a smidge better and can answer questions? Every student will have the King's Tutor - it will be Blooms Two Sigma in action. ...which will drive down the cost of all knowledge work and rather than reconfigure our society we'll simply have no entry level jobs anymore and the few people who still have jobs will still be expected to work full time but have insane outputs. This whole thing is a Mo…

Why have a job when you have all the knowledge to sustainably live off the grid? I expect self-employment to skyrocket.