Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Having a 20GB file that lets you ask an offline computer any question is amazing

old.reddit.com

Post reply on HN
Print view View original

71–80 of 127 posts

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#71

Post by bheadmaster »

GeneralMayhem wrote: post #60
bheadmaster wrote: post #37

Earlier quoted context omitted.

US politics, definitely. But also any other topic that attracts an internet mob large enough to infiltrate the editor community. Take the first few paragraphs of Donald Trump [0] vs. Joe Biden [1] and try to compare the way they're presented: Donald John Trump [...] and his businesses have been involved in more than 4,000 state and federal legal actions, including six business bankruptcies. Trump promoted conspiracy…

Your [...] are very convenient, because you skipped over the part in paragraph 3 of Trump's article where they go over some of his main "achievements", which are presented neutrally and some people might consider positive: [Trump] signed the Tax Cuts and Jobs Act of 2017, which cut taxes for individuals and businesses and rescinded the individual health insurance mandate penalty of the Affordable Care Act. He appoint…

> Donald Trump spent his four years in office much like he spent most of his previous business career: lying and committing various forms of fraud. While president, just for variety, he added lying and committing fraud about COVID, and, oh yes, inciting a violent insurrection to overthrow the American government.

Interesting that I can't find any reference for such claims in the Wikipedia article. The whole introductory paragraph contains the total of 2 sources - one a politico.com article [0] and the other a Siena College Research Institute post [1] - neither of which provide any claims other than that Trump was unpopular and "rated as worst".

You can't with a straight face claim that this is unbiased writing.

[0] https://www.politico.com/news/2021/06/30/trump-cspan-preside...

[1] https://scri.siena.edu/2022/06/22/american-presidents-greate...

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#72

Post by fsflover »

samwillis wrote: post #38
sircastor wrote: post #22

Earlier quoted context omitted.

I also don’t want my AI in the cloud favoring a corporation’s values and goals. But these tools are almost certainly going to come from them. And they want you to store all your data in the cloud too. And they want to keep you from running the software you want.

I think there is one company very well placed to do this, Apple. Their revenue is driven by hardware sales, rather than advertising, and they have committed to some level of "privacy" focussed design (although obviously there are criticisms). On top of that their hardware is looking almost like it was design for exactly these use cases. Apple silicone with its unified memory architecture, GPU and Neural cores is very…

> Apple have a history of doing stuff locally, on the hardware they designed, that other companies have offloaded to the cloud.

Looking at how they promote using iCloud on iDevices, I doubt that.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#73

Post by Krutonium »

shortcake27 wrote: post #62
jaimex2 wrote: post #54

Earlier quoted context omitted.

Cloud gaming was a crash and burn story already. There's a stronger resistance to cloud than ever before after all the leaks, hacks and pushed agendas. These models aren't cheap to host and they'll lose to free local models that don't have boundaries or agendas. Cloud AIs inevitably will try and monetise by selling you crap or be funded to shape your opinions.

> Cloud gaming was a crash and burn story already. What? No it isn’t. One company failing doesn’t mean the industry has crashed and burned. I use Xbox cloud gaming all the time along with millions of other people.

Even Microsoft has admitted (between the lines) that cloud gaming isn't as profitable as just selling games. And it's not just one company that's failed either. Google, Onlive, Gaikai, there was a company that made a Cloud console a couple years back, the list goes on. Besides, the latency will never be low enough, and the bandwidth cheap enough, for a lot of people to make it a viable solution.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#74

Post by cromka »

avian wrote: post #63
_neil wrote: post #12

Earlier quoted context omitted.

Maybe you’re asking the wrong questions

Correct. Parent commenter seems to be asking questions they already know the answer to. Those are the wrong kind of questions. They should only ask the questions about things they don't know anything about. ChatGPT gets those right every time.

I appreciate the facetiousness.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#75

Post by triggerity »

samwillis wrote: post #38
sircastor wrote: post #22

Earlier quoted context omitted.

I also don’t want my AI in the cloud favoring a corporation’s values and goals. But these tools are almost certainly going to come from them. And they want you to store all your data in the cloud too. And they want to keep you from running the software you want.

I think there is one company very well placed to do this, Apple. Their revenue is driven by hardware sales, rather than advertising, and they have committed to some level of "privacy" focussed design (although obviously there are criticisms). On top of that their hardware is looking almost like it was design for exactly these use cases. Apple silicone with its unified memory architecture, GPU and Neural cores is very…

Pretty every Google, Microsoft, Amazon, Samsung and apple can do that.

Everyone has a huge motivation to get this solved.

But because all of them also have their cloud storage and every customer is trusting their company I'm pretty sure most will not use local ai.

Until when suddenly in 10 years we have hardware chips like gpt-8 hardware version or something.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#76

Post by triggerity »

jaimex2 wrote: post #54
mFixman wrote: post #52

Earlier quoted context omitted.

Computers are becoming smaller and the internet is becoming even more ubiquous. I don't see your future happening. Why would I spend a lot of money, space, and maintenance time for a computer with a good GPU when I can just use any of the two internet connections I'm already paying for? I'm already trusting corporations to read my email, and no ChatGPT answer can get more personal than that. This is also why I think…

Cloud gaming was a crash and burn story already. There's a stronger resistance to cloud than ever before after all the leaks, hacks and pushed agendas. These models aren't cheap to host and they'll lose to free local models that don't have boundaries or agendas. Cloud AIs inevitably will try and monetise by selling you crap or be funded to shape your opinions.

Gaming is a total different field.

Hard to make any assumptions out of this.most people I know definitely sync there data onto companies cloud storage.

Alone for image backups and sharing and etc. No one minds that.

No one minds mail analysis either.

Cloud is healthy, very healthy

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#77

Post by triggerity »

the_third_wave wrote: post #18
behnamoh wrote: post #7

My goal: download the entire Wikipedia and store it in a vector db. Then have a local LLM answer questions based on Wikipedia. Best of both worlds!

Given the biased nature of many if not most Wikipedia articles it would be certain that such a system would bend the truth to an unacceptable degree. Train the thing on more than just Wikipedia, e.g add Encyclopedia Britannica to the training set. This is the one area where "diversity" really matters: diversity of opinion. Using a single biased source as your oracle will turn you into a pawn for those who control the…

I would probably also try to add more sources than Wikipedia but I don't think your critic has any day to day consequences at all.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#78

Post by triggerity »

bheadmaster wrote: post #37
_ZeD_ wrote: post #25

Earlier quoted context omitted.

what? since when wikipedia is biased? and about what? (and why EB isn't?)

US politics, definitely. But also any other topic that attracts an internet mob large enough to infiltrate the editor community. Take the first few paragraphs of Donald Trump [0] vs. Joe Biden [1] and try to compare the way they're presented: Donald John Trump [...] and his businesses have been involved in more than 4,000 state and federal legal actions, including six business bankruptcies. Trump promoted conspiracy…

I mean trump is a gigantic clusterfuck.

Why is this not objective enough?

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#79

Post by outofpaper »

samwillis wrote: post #11

I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…

Yes, I whole-heartedly agree. What we need is a proliferation of AI tools. Centralization of compute in the hands of a few corporations could be worse than monoculture farming. If we don't create, mix, and match our own models we're offloading all decisions to opaque companies like the "open" OpenAI.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#80

Post by zirgs »

npteljes wrote: post #67
karmakurtisaani wrote: post #51

Earlier quoted context omitted.

It baffles me how you can either have a news/information source with a left-wing bias or a total cesspool of untrustworthy information with a glaringly obvious agenda. This comment seems to get some hate, but all you have to do is skim over the linked Wikipedia article to verify what I'm saying.

I agree, and for another demonstration, I invite everyone to look at similar sites as Wikipedia. They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). It almost looks like that if you organize basic democratic cooperation among people, that's automatically "left wing" from where our current narrative stands.

Some parts of RationalWiki aren't that rational any more, unfortunately.
Post reply on HN