Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Having a 20GB file that lets you ask an offline computer any question is amazing

old.reddit.com

Post reply on HN
Print view View original

101–110 of 127 posts

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#101

Post by the_third_wave »

_ZeD_ wrote: post #25
the_third_wave wrote: post #18

Earlier quoted context omitted.

Given the biased nature of many if not most Wikipedia articles it would be certain that such a system would bend the truth to an unacceptable degree. Train the thing on more than just Wikipedia, e.g add Encyclopedia Britannica to the training set. This is the one area where "diversity" really matters: diversity of opinion. Using a single biased source as your oracle will turn you into a pawn for those who control the…

what? since when wikipedia is biased? and about what? (and why EB isn't?)

> since when wikipedia is biased

Since the first article hit the site which clearly showed off the personal bias of the author. Then since the first article was edited by a group of like-minded editors who approved of each others edits but were vigilant in keeping other opinions off the page. These groups of editors come in different flavours ranging from ideologically driven [1] - these control the narrative on pages related to politics and politically sensitive topics like SARS2 and "Climate" - to commercially employed to keep unwanted narratives off certain pages.

> and why EB isn't?

Who says that Encyclopedia Britannica is not biased? They are to a certain (although lesser) extent, they just happen to be differently biased. That is where my remark on the value of diversity of opinion comes in.

[1] https://thecritic.co.uk/the-left-wing-bias-of-wikipedia/

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#102

Post by yieldcrv »

samwillis wrote: post #11

I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…

These things will inevitably be included with the OS soon

Desktop, mobile, even consoles - especially video game consoles where games can tap into the shared resource for their NPCs instead of bundling it in their package

GPU based token generation will be good enough in speed

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#103

Post by npteljes »

the_third_wave wrote: post #98
npteljes wrote: post #67

Earlier quoted context omitted.

I agree, and for another demonstration, I invite everyone to look at similar sites as Wikipedia. They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). It almost looks like that if you organize basic democratic cooperation among people, that's automatically "left wing" from where our current narrative stands.

> They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). #/bin/env bash read -p "Please enter your personal bias (e.g. conservative, liberal, progressive, etc.) philisophy: " bias echo "they are either ${bias}ly biased or with an agenda, divorced from reality."

Do you think the same about OP's statement that I reflected on, stating "you can either have a news/information source with a left-wing bias or a total cesspool of untrustworthy information with a glaringly obvious agenda"?

As a point of reference, if you search high traffic websites with "Left bias" and also with "Right bias"[0], it will turn out that the average factuality of the sources are higher on the "Left bias" news sources.

This makes me think that the point of reference, the "center", is now off-center, to the right. To the point where actual reality seems "left". "Facts Have a Well-Known Liberal Bias". Considering this, sources even further to the right will of course have worse information, same as they would on the far left. And this is for news sources - what I added was that I observed the same for wikis.

[0] https://mediabiasfactcheck.com/filtered-search/?bias=Left&tr...

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#104

Post by koonsolo »

samwillis wrote: post #11

I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…

It's probably the future you want. But fact is, most of peoples emails, documents, browser history, travel history, bookmarks, contacts, etc., already live in the cloud. People are obviously not concerned with it, so I would say the future of LLM's is in the cloud using all of the cloud data.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#105

Post by karmakurtisaani »

the_third_wave wrote: post #98
npteljes wrote: post #67

Earlier quoted context omitted.

I agree, and for another demonstration, I invite everyone to look at similar sites as Wikipedia. They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). It almost looks like that if you organize basic democratic cooperation among people, that's automatically "left wing" from where our current narrative stands.

> They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). #/bin/env bash read -p "Please enter your personal bias (e.g. conservative, liberal, progressive, etc.) philisophy: " bias echo "they are either ${bias}ly biased or with an agenda, divorced from reality."

That's a cute way to say essentially nothing.

Edit: feel free to defend the Conservapedia's take on climate change for example https://www.conservapedia.com/Climate_change. Absolutely laughable bullshit.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#106

Post by soupfordummies »

cookieperson wrote: post #89
samwillis wrote: post #11

I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…

So a hackers main goal will be to get your LLM data, and companies will be backdooring them?

Yeah, I would definitely be leaning into the "offline" word in the original title for something like this.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#107

Post by pentagrama »

I think this will be more mainstream if someone create an installable app (win/mac/linux), right now I did a bit of research and I have to install several stuff (with https://huggingface.co/), it was confusing to a non advance user, I wasn't able to do it.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#108

Post by singularity2001 »

throw0101b wrote: post #94
singularity2001 wrote: post #92

Earlier quoted context omitted.

yes someone please annotate/convert wikipedia and make it available as torrent!!

https://meta.wikimedia.org/wiki/Data_dump_torrents ?

* in vector encoding

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#109

Post by roarcher »

cookieperson wrote: post #89
samwillis wrote: post #11

I am completely convinced the future is local LLMs, privet, on your device. But then also fine tuned with your own data. All your documents, email, movements, browser history - maybe it even gets trained on your calls. Effectively an extension to your own brain. I really don't want my AI assistant in the cloud, controlled by a corporation, reading and seeing everything I do. I would go as far as saying I want local A…

So a hackers main goal will be to get your LLM data, and companies will be backdooring them?

Why would this be a risk? The data is already on your machine. It would be much easier for a hacker to target that data directly, as they do today, than to try to extract some impossibly obfuscated form of it from an LLM.

Re: Having a 20GB file that lets you ask an offline computer any question is amazing

#110

Post by npteljes »

karmakurtisaani wrote: post #105
the_third_wave wrote: post #98

Earlier quoted context omitted.

> They are either "left wing bias" (RationalWiki) or one with an agenda, divorced from reality (Conservapedia). #/bin/env bash read -p "Please enter your personal bias (e.g. conservative, liberal, progressive, etc.) philisophy: " bias echo "they are either ${bias}ly biased or with an agenda, divorced from reality."

That's a cute way to say essentially nothing. Edit: feel free to defend the Conservapedia's take on climate change for example https://www.conservapedia.com/Climate_change . Absolutely laughable bullshit.

While it was not said out loud, it reminded me of the "both sides" fallacy. Like how schools should teach both sides, creationism and evolution, as if both have the same merit. Likewise, the bash script implies that bias is bias.

https://en.wikipedia.org/wiki/False_balance

Post reply on HN