Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

401–410 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#401

Side note: Yandex search is awesome, and I really hope they stay alive forever. It's the only functional image search nowadays, after our Google overlords neutered their own product out of fear over lawyers/regulation and a disdain for power users. You can't even search for images "before:date" in Google anymore.

[deleted]

Re: YaLM-100B: Pretrained language model with 100B parameters

#402

What are some use cases for something like this? I understand it says "generating and processing text", but is it a replacement for OCR? Or something else?

No, it is more like generating a conversations, translating text, summarization texts, writing code, etc.

If I wanted to use it for summarization, what would I have to do?

Re: YaLM-100B: Pretrained language model with 100B parameters

#404

Earlier quoted context omitted.

no it's not. they straight up serve kremlin, promoting kremlin fake news and silencing russian opposition (not much to silence but still). they can have whatever functionality they like, I still won't use it in billion years.

Quoted post unavailable.

Every country is or has been bad in some context in different times, because doing the interests of your country often translates into doing harm to some others. Yandex is a really nice search engine and I agree it's excellent for image searches compared to Google results polluted with Pinterest links and other cancerous SEO rubbish. But does Yandex echo propaganda for the Kremlin? Yes of course, as do Google and most of the others for their advertisers and governments, albeit to some different degrees. The usual approach when someone or some company with a controversial public image does something good with apparently no strings attached should be "Timeo Danaos et dona ferentes", that is, take the gift but don't trust them, mo matter if they're called Google, Microsoft, Yandex or whatever. Their purpose is of course to associate the Yandex brand, and therefore Russia, to something perceived as good, have more people use it, so that more users will be exposed to their filtered news. Just be aware of that, take the good and ignore the rest.

Re: YaLM-100B: Pretrained language model with 100B parameters

#406
post #342

Earlier quoted context omitted.

Open the vocab file (from the script in the download directory) and you can get a pretty good idea. Looks to be approximately 50/50 from my random scrolling through the list.

That's because English and Russian have pretty similar vocabulary size. Vocabulary does not reflect the size of the data.

In this case, it does, because the vocab is not a list or words, but a list of tokens. Each token may be a word, but it might also be a phrase or part of a word. The tokens are generated to be optimal on the input data - ie. for a given vocab size to minimize the number of tokens to represent it.

Therefore, the size of the vocab gives a good guide to the size of the data, since if there was 10x more english language data then the optimal distribution would be to dedicate more token space to english than russian.

Re: YaLM-100B: Pretrained language model with 100B parameters

#407
post #147

Quoted post unavailable.

Not for being Russians, but for active participation in censorship by tweaking their news aggregation to show only hand picked government approved sources

Exactly what google has been doing the past year or two.

Re: YaLM-100B: Pretrained language model with 100B parameters

#408
post #368

Earlier quoted context omitted.

Case in point: recently, I've noticed that I'm getting more and more emails with the sign off "Warm regards." This is not a coincidence. It is an autosuggestion from Google. If you start signing off an email, it will automatically suggest "Warm regards." It just appears there -- probably an idea generated from an AI network. There are more and more of these algorithmic "suggestions" appearing every day, in more and m…

Those suggestions are very few so I suspect they were hand-picked.

I don’t know if this is how it still works, but early attempts were modeled as classification problems with hundreds of hand picked completions. Can’t predict something really bad if it isn’t in your prediction list. This limits the surface of bad things to cases of tone mismatch like “sounds great” when talking about someone grieving a loss or something.

Re: YaLM-100B: Pretrained language model with 100B parameters

#409
post #386

Earlier quoted context omitted.

Quoted post unavailable.

Quoted post unavailable.

>I reject the false equivalence of the DHS and FSB. Not gonna both-sides this, sorry.

lmao mkay. Not identical, but very similar. It's not even 'Alex Jones'-tier to say this. I think you forget you are if you are under US or (even NATO). YOU WILL hear propaganda from your side, as the Russians do. It's NORMAL. We live under control of a hegemon with self-interests.

May I have to remind you of these? And tell me the difference between these and Russian spookery:

>Assange was being hunted down by the US worldwide (https://diem25.org/exactly-10-years-ago-wikileaks-released-a...)

>https://en.wikipedia.org/wiki/Operation_Mockingbird

>https://en.wikipedia.org/wiki/Operation_Northwoods

>https://en.wikipedia.org/wiki/PRISM

I could go on, but the point was made already.

Edit: So yes, it's actually 'both sides'

Re: YaLM-100B: Pretrained language model with 100B parameters

#410
post #332

Earlier quoted context omitted.

Oh I see. What I'm looking for is the reason why they broke the reverse image search. It was working well many years ago but some time after that they switched it to some strange image classifier (I upload an image of an apple to find exactly the same image to track its license of origin, and it says "possibly an image of an apple" - oh thank you Google I didn't know that.)

Tineye works reasonably well, for finding exactly the same image (including different resolutions, crops, etc.) https://tineye.com/

> Tineye works reasonably well, for finding exactly the same image (including different resolutions, crops, etc.)

Tineye is definitely better than Google with crops, etc. Google reverse image search seems to have more data, but it seems much less able to recognize even basic modifications to the input.

Post reply on HN