Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Yandex open-sources its exabyte-scale big data platform

medium.com

Post reply on HN
Print view View original

61–70 of 104 posts

Re: Yandex open-sources its exabyte-scale big data platform

#61

Post by orbital-decay »

ClumsyPilot wrote: post #59
maxdo wrote: post #39

Earlier quoted context omitted.

It's a problem of entire Russia. My Asian girlfriend from china was denied to enter a restaurant in Moscow because of her origins... It's absolutely legal to put restrict your rental apartments nationality. In yandex you can ads like " will lease my house only to russians". It's everywhere. If you will ride a taxi in russia, an offensive words to other nationalities/ethnicities is everywhere. The problem is so big, t…

> It's absolutely legal to put restrict your rental apartments nationality. I believe it is still illegal 'hypothetically', just like hypothetically Russia has elections. > They think it's their strength Yeah, the delusion is serious

It's illegal but the rental contract is private, so it can be denied without explanation; good luck suing and proving that you're being discriminated.

The discrimination in public ads and places like restaurants is strictly illegal, though essentially not enforced unless you sue, because of the multitude of reasons - racism and lax anti-discrimination policies in particular, and also a million of others (the entire rental housing market is almost unregulated, for one). Lately, most popular ad sites implemented their own discrimination bans, however it still doesn't guarantee that the landlord won't be an asshole.

Re: Yandex open-sources its exabyte-scale big data platform

#62

Post by arivkin »

xpl wrote: post #18
garbagecoder wrote: post #12

Didn't this just leak?

AFAIK it wasn't in the leak (that "YT" platform specifically). Also, open-sourcing proprietary projects of this scale is a pretty hard job and it can't be done quickly — seems they had been doing it for a long time, starting long before the leak.

That's true. We have been preparing for opening YT for a long time when we found out about the leak. We even joked inside that they couldn't even do it normally and we still have to open our part of the code ourselves :)

It's truly a hard work, because we were very tightly tied to the Yandex infrastructure and we had to learn how to deploy in k8s from scratch. Also you need a new brand and clean your documentation from irrelevant things... All this takes months.

Re: Yandex open-sources its exabyte-scale big data platform

#66

Post by medo-bear »

orbital-decay wrote: post #61
ClumsyPilot wrote: post #59

Earlier quoted context omitted.

> It's absolutely legal to put restrict your rental apartments nationality. I believe it is still illegal 'hypothetically', just like hypothetically Russia has elections. > They think it's their strength Yeah, the delusion is serious

It's illegal but the rental contract is private, so it can be denied without explanation; good luck suing and proving that you're being discriminated. The discrimination in public ads and places like restaurants is strictly illegal, though essentially not enforced unless you sue, because of the multitude of reasons - racism and lax anti-discrimination policies in particular, and also a million of others (the entire r…

> It's illegal but the rental contract is private, so it can be denied without explanation; good luck suing and proving that you're being discriminated.

How is this different than in other places in Europe

Re: Yandex open-sources its exabyte-scale big data platform

#68

Post by arivkin »

rch wrote: post #64
magundu wrote: post #63

Is it an alternative to Snowflake?

I work at Cloudera and I see it as roughly analogous to CDP, but I didn't see anything about hybrid on-prem/cloud deployments.

It's true. We are very close to CDP and Apache Hadoop. We are only about on-prem right now. It's not a secret that we didn't need a cloud deployment at Yandex. But we see and understand the demand for it. And we have a plan:)

Re: Yandex open-sources its exabyte-scale big data platform

#70

Post by helge9210 »

ClumsyPilot wrote: post #57
speed_spread wrote: post #37

Earlier quoted context omitted.

You can take Yandex out of Russia... but you can not take Russia out of Yandex. Admittedly, the same could probably be said about any other $big_search:$nuclear_power pair. It's just that the other companies either can't or have no reason for exile. And so I suspect Yandex leaving it's home turf would essentially be a covert invasion of wherever they'd swarm to. Somehow, money tells me UK would be a likely target. So…

> a covert invasion of wherever they'd swarm to. > an exiled Russian company. Either you are exhiled or you are invading, how can you be both?

For example, you wholeheartedly support the policy, but are not comfortable living under the sanctions.
Post reply on HN