Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Dav2d

code.videolan.org

Post reply on HN
Print view View original

81–90 of 199 posts

Re: Dav2d

#81

Post by thresh »

hectormalot wrote: post #65
thresh wrote: post #16

Earlier quoted context omitted.

We had to set it up on the parts of VideoLAN infra so the service would remain usable. Otherwise it was under a constant DDoS by the AI bots.

Maybe I’m naive about this, but I didn’t expect AI scrapers to be that big of a load? I mean, it’s not that they need to scrape the same at 1000+ QPS, and even then I wouldn’t expect them to download all media and images either? What am I missing that explains the gap between this and “constant DDoS” of the site?

You cant really cache the dynamic content produced by the forges like Gitlab and, say, web forums like phpbb. So it means every request gets through the slow path. Media/JS is of course cached on the edge, so it's not an issue.

Even when the amount of AI requests isnt that high - generally it's in hundreds per second tops for our services combined - that's still a load that causes issues for legitimate users/developers. We've seen it grow from somewhat reasonable to pretty much being 99% of responses we serve.

Can it be solved by throwing more hardware at the problem? Sure. But it's not sustainable, and the reasonable approach in our case is to filter off the parasitic traffic.

Re: Dav2d

#82

Post by Almondsetat »

notenlish wrote: post #51
Almondsetat wrote: post #44

Earlier quoted context omitted.

What are you even implying?

I think they mean that video decoders and encoders tend to have custom assembly code for speedup.

And? It's common knowledge that the "reference" or "research" version of any codec is always quite high level to get development going and actually produce a working bitstream

Re: Dav2d

#83

Post by thresh »

nijave wrote: post #69
thresh wrote: post #16

Earlier quoted context omitted.

We had to set it up on the parts of VideoLAN infra so the service would remain usable. Otherwise it was under a constant DDoS by the AI bots.

While I do sympathetize with the AI DDoS situation, it'd be nice if there were a solution that allows them to work so they can pull official docs. For instance, MCP, static sites that are easy to scale, a cache in front of a dynamic site engine

Of course, static websites is the best solution to that problem.

Our documentation and a main website are not fronted by this protection, so they're still accessible for the scrapers.

Re: Dav2d

#85

Post by WhatIsDukkha »

fguerraz wrote: post #28
dcsommer wrote: post #18

We must not continue to develop media codecs in memory unsafe languages. Small, auditable sections can opt-out perhaps, but choosing default-unsafe for this type of software is close to professional negligence.

Cryptography and video codecs are notable exceptions, they put a lot of effort to making the code provably memory safe: no recursion, limited use of stack variables, no dynamic allocations, etc. As a result, memory safe languages bring nothing but trouble by making it non deterministic, that’s especially true for crypto where compiler “optimisations” guarantee you side channels attacks.

Thank you for mentioning this.

I wonder IFF Rust had an effects system that a Jasmin MIR transform (ie like SPIRV is for shaders) would be useful?

https://github.com/jasmin-lang/jasmin

Re: Dav2d

#86

Post by mort96 »

ronsor wrote: post #49
delfinom wrote: post #25

Earlier quoted context omitted.

looks at if AV2 is dead in the water https://www.sisvel.com/insights/av2-is-coming-sisvel-is-prep... yep

This is a thinly veiled extortion racket and any competent system would fine them into bankruptcy.

We need a more efficient way to eliminate bullshit patents or bullshit patent infringement claims than "violate them then spend millions on lawyers to fight them in court".

Re: Dav2d

#87

Post by brookst »

mort96 wrote: post #86
ronsor wrote: post #49

Earlier quoted context omitted.

This is a thinly veiled extortion racket and any competent system would fine them into bankruptcy.

We need a more efficient way to eliminate bullshit patents or bullshit patent infringement claims than "violate them then spend millions on lawyers to fight them in court".

Sure, and at the same time we need a more efficient way to ensure big companies can’t just take what they want and bury anyone who complains.

It’s not an easy problem.

Re: Dav2d

#88

Post by flykespice »

virtualritz wrote: post #11
xnx wrote: post #6

[flagged]

And who ever heard of this in the majority of the world? It was news to me, I'm white and European btw. Did you know the US consititues about 4% of humans? When we look at adults and age range that likely ever hear of D4vd we are talking probably considerably less that 1%. The rest of humanity has no negative association with these four letters.

> I'm white and European btw.

Why did you feel the need to explicitly specify that you're white as one of the reasons you didn't hear the news?

I'm not american either, but the news is all over social media platforms like reddit and Twitter, it's hard to turn a blind eye on them.

Re: Dav2d

#89

Post by dyauspitr »

throw-the-towel wrote: post #32
dyauspitr wrote: post #30

Earlier quoted context omitted.

There’s definitely lots of problems with the ruling class and wealth disparity. Perhaps the defining problems of our current age. That being said, so many of the plebs suck. Like 2% will ruin everything for everyone.

While a lot of the plebs do suck, a pleb who sucks causes way less problems than a big corp that sucks simply by virtue of not having too much resources.

I agree.

But whether you agree with me or not, most paradigm shifting changes come from billionaires/corps because they are the only ones with the money to pull off massive shifts. Most innovation is not grassroots and heavily funded by the “elites”. This is how most successful countries have been for atleast the last 100 years. So billionaires add a lot of value even as they cause a lot of pain.

The solution in my mind is we absolutely need uncapped billionaires but they need to be effectively taxed (not like 90% but closer to 50%) and they have to have absolutely no influence on the government.

Re: Dav2d

#90

Post by dmitrygr »

jorvi wrote: post #68
walrus01 wrote: post #31

Earlier quoted context omitted.

I see zero public evidence that they've filed any lawsuits against the members of AOM in any jurisdiction. I'm sure there's been a lot of threatening letters sent...

Yup. The Dolby/Disney vs Snapchat lawsuit is going to be the first one. So far it's only been filed. The big question is if AOMedia is going to make good on their Mutually Assured Destruction promise of using their patent and financial war chest to to countersue into oblivion anyone trying to go after AV1 adaptors.

I would love to live in a world where this happens. I will place big bets that it will, regrettably not happen.
Post reply on HN