Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

YaLM-100B: Pretrained language model with 100B parameters

github.com

Post reply on HN
Print view View original

581–590 of 666 posts

Re: YaLM-100B: Pretrained language model with 100B parameters

#581

Post by xpl »

The_Colonel wrote: post #569
xpl wrote: post #568

Earlier quoted context omitted.

> Cancelling Yandex completely, as in forcing it to collapse, would help a lot. It's just a wishful thinking. It wont "collapse", it would just become controlled by government, and then it truly becomes the instrument of the evil, so that not only News, but every service Yandex provides will serve the government needs. They will recruit soldiers through Yandex services, they make Yandex develop AI-controlled tanks an…

> It's just a wishful thinking. It wont "collapse", it would just become controlled by government That's why part of my suggestion is to burn the equipment/infrastructure and delete the code. > They will recruit soldiers through Yandex services, they make Yandex develop AI-controlled tanks and whatnot And the only thing stopping them now from doing that is that Yandex is not nationalized. Yeah, sure. > Of course not,…

> Russia can't sustain waging wars if they don't have an economy and disgruntled population.

Russia can wage wars on natural resource selling alone, it only needs to keep the gas and oil flowing through the infrastructure. All those private companies' activities the government sees mostly as a distraction, it doesn't give a damn about them (until they get in the way). They don't matter much.

It's very much unlike the Western economies where the private companies drive the economy. Russia is more like a giant oil and gas pipe with military industrial complex around that.

> exception of VK, there isn't really any step-in competition to Yandex

If we talk about city services (taxi, delivery, online shopping) there are lots of other players. Search/mail/social — then yeah, apart from VK not many. And VK is in fact state-owned. Yandex is not. So if Yandex leaves the scene, the only game in town would be state-owned. This only reinforces the evil regime.

> That's why part of my suggestion is to burn the equipment/infrastructure and delete the code.

It's pretty unrealistic. You can do it in small company, easy. In a huge decentralized company I don't know how one could even pull that off. There simply isn't a way to "delete all the code", nor a single place you could burn all the servers. It just doesn't have a kill switch. And the moment you try that, the government swoops in and goodbye the company.

> And the only thing stopping them now from doing that is that Yandex is not nationalized. Yeah, sure.

If Yandex gets nationalized, the government will replace the management and the uncooperative employees. Most of them would just leave the day it happens. It won't be Yandex anymore of course. That is essentially the same as killing the company, but worse, as the remnants could still be used for evil.

Re: YaLM-100B: Pretrained language model with 100B parameters

#582

Post by golem14 »

paganel wrote: post #352
colechristensen wrote: post #280

Earlier quoted context omitted.

An 80GB nvidia A100 goes for $20k and uses 300 watts, the energy costs of using one (or three) isn’t going to surpass the hardware costs for… a while.

I wanted to add that I was writing it metaphorically in a way, as in, seeing as how high those energy bills will be they might as well all add up to 60k. Not sure about most of the people in here, but I would get really nervous at the thought of running something that eats up 3x300 watts per hour, for 24/7, just as part of a personal/hobby project. The incoming power bills would be too high, you have to be in the wag…

You must not have a pool :)

Re: YaLM-100B: Pretrained language model with 100B parameters

#583

Post by daniel-cussen »

2Gkashmiri wrote: post #434
sanxiyn wrote: post #369

Earlier quoted context omitted.

Automotive companies, in fact, have product liability. It's about liability, not morality.

when you release a project into the wild under a permissive license, aren't you essentially washing yourself from any "liability" ? > MIT " IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE." don't commercial lic…

So they do that because they're doing it for free. Otherwise they couldn't be generous with their work--those licenses are about permitting the generous intent.

Re: YaLM-100B: Pretrained language model with 100B parameters

#584

Post by jhgb »

narrator wrote: post #508

I love Yandex. They are the best search engine by far for politically controversial topics. They also release a language model to benefit everyone even if it says politically incorrect stuff. They also name their projects "cocaine" probably to perhaps to prevent western competitors from using them. You look at OpenAI and how they don't release their models mainly because they fear "bad people" will use them for "bad…

> This is the trend in the west. Technology is too powerful, we must control it!

I take it that you're either too young or too untraveled to be aware of the level of state control of technology in "the east". Xerographic machines, mimeographs, and other similar reprographic devices used to be highly controlled machinery behind the Iron Curtain. This is absolutely not something exclusive or even peculiar to "the west".

Re: YaLM-100B: Pretrained language model with 100B parameters

#585

Post by jhgb »

cpursley wrote: post #580
risyachka wrote: post #571

Earlier quoted context omitted.

>> They are the best search engine by far for politically controversial topics FYI, they are Russian subject that follows ALL their censorship laws (and oh boy do they have a lot of it). >> probably to perhaps to prevent western competitors from using them The irony here. All yandex products are exact copies of western, adjusted to local market.

Actually they're not, some of the Yandex products are actually better and pretty innovative (ignoring the political stuff). Maps and Go are especially good. Ditto with Russian banking apps, they put American bank apps to shame.

Wait, so you're saying it's a Russian company breaking Russian laws and getting away with it?

Re: YaLM-100B: Pretrained language model with 100B parameters

#587

Post by justinlloyd »

kfrzcode wrote: post #529
justinlloyd wrote: post #498

Earlier quoted context omitted.

Oh yeah, that $750 for 256GB of DDR-4 is going to totally break the bank.

Damn I didn't know ram was so cheap

It only gets expensive if you insist on sourcing it from enterprise vendors. The first 256GB I paid $2,400 for. The second 256GB I paid $1,200 a little over a year later. And the third 256GB I paid $800 about seven months later. I've got a workstation with 768GB DDR4 and I am considering upping that to 1.5TB if the prices on the 256GB sticks will come down.

Re: YaLM-100B: Pretrained language model with 100B parameters

#588

Post by cpursley »

jhgb wrote: post #585
cpursley wrote: post #580

Earlier quoted context omitted.

Actually they're not, some of the Yandex products are actually better and pretty innovative (ignoring the political stuff). Maps and Go are especially good. Ditto with Russian banking apps, they put American bank apps to shame.

Wait, so you're saying it's a Russian company breaking Russian laws and getting away with it?

I could have worded that better. I just mean ignoring the general political situation in Russia, Yandex makes some really good products.

Re: YaLM-100B: Pretrained language model with 100B parameters

#589

Post by Barrin92 »

jhgb wrote: post #585
cpursley wrote: post #580

Earlier quoted context omitted.

Actually they're not, some of the Yandex products are actually better and pretty innovative (ignoring the political stuff). Maps and Go are especially good. Ditto with Russian banking apps, they put American bank apps to shame.

Wait, so you're saying it's a Russian company breaking Russian laws and getting away with it?

> it's a Russian company breaking Russian laws and getting away with it

I don't think you've lived in Russia if you need to ask that question. Breaking the law and getting away with it is a way of life in Russia, that goes for all institutions and social strata

Re: YaLM-100B: Pretrained language model with 100B parameters

#590

Post by stainablesteel »

alphabetting wrote: post #558
narrator wrote: post #553

Earlier quoted context omitted.

Search Google and Yandex for "2020 election fraud." The results are VERY different. The Zach Vorhies leak shows that Google regularly does blatant censorship for political purposes.[1] [1] https://www.breitbart.com/tech/2021/08/19/google-whistleblow...

Google: 118M results. Top link is the best resource on verified election fraud cases. Yandex: 9M results. The top two links are pretty suspect. Top link promotes Dinesh D'Souza's 2000 Mules documentary in the banner which at best is a one-sided take on election fraud. At worst, very misleading. https://i.imgur.com/n5a9LOd.png

This is a weird comment because yes, that's exactly what the above person was saying. It shows results that google won't give you.

Secondly, I've yet to see any criticisms of 2000 mules data that aren't addressed by the stringency in the analysis they claim to have done.

I thought the information they presented was extremely valuable. Are we going to overturn an election at this point? No. But the vulnerabilities to the mail-in ballots were obvious, then lied about, then ignored, then clearly taken advantage of. I want to live in a democracy because voting matters. I especially don't want NPO's destroying this by taking advantage of flawed voting infrastructure.

If there are legitimate criticisms of the methods, the data, or anything else coming out of this film I expect a legitimate presentation that can break it down using the actual data in question. All I've seen so far is shilling and gas-lighting.

Post reply on HN