Live data from Hacker News

New improvements to IPFS Bitswap for faster container image distribution

blog.ipfs.io

31–40 of 61 posts

Re: New improvements to IPFS Bitswap for faster container image distribution

#31
post #8

Earlier quoted context omitted.

I don't disagree, but what they use it for, at what scale and at what priority matters a lot

Read the article? They were experimenting with using IPFS to distribute container images across AWS regions. And they do it at Netflix scale...

Didn't they talk about distributing Docker containers for their developers?

I mean, they have many devs, but that's still a few magnitudes below their number of viewers.

Re: New improvements to IPFS Bitswap for faster container image distribution

#32
post #19

Earlier quoted context omitted.

The article doesn't mention IPNS at all, nor does it talk about the need for mutating an image while it is being shared, so I'm not sure why you think IPNS is even desirable in this use-case?

I would think because IPNS is IPFS.. and you asked how IPNS compares to BitTorrent. Maybe I misunderstand your question, but the reply seems totally on topic and a valid answer to your question.

IPNS is a system that runs on top of IPFS. You do not need IPNS to use IPFS.

Re: New improvements to IPFS Bitswap for faster container image distribution

#33
post #19

Earlier quoted context omitted.

The article doesn't mention IPNS at all, nor does it talk about the need for mutating an image while it is being shared, so I'm not sure why you think IPNS is even desirable in this use-case?

"Inter-Planetary Name System (IPNS) is a system for creating and updating mutable links to IPFS content. Since objects in IPFS are content-addressed, their address changes every time their content does. That's useful for a variety of things, but it makes it hard to get the latest version of something." https://docs.ipfs.io/guides/concepts/ipns/ TLDR IPNS are pointers to IPFS content (ie "latest"). If you're tracking…

Thanks, but I already know what IPNS is. My points were that (a) it's not needed for this use-case, and (b) it's a distinct system from IPFS. I think you agreed in your TLDR.

Re: New improvements to IPFS Bitswap for faster container image distribution

#34

Saving Netflix's bandwith costs by sacrificing your privacy. IPFS and bittorrent don't do anything to protect the data you are uploading and your IP address. Case in point: https://iknowwhatyoudownload.com/en/peer/ Now every website you visit, any ad/tracker, any homecalling phone app can tell what movies and contents you watch and when you are at home. For years.

IPFS/libp2p is meant to be modular in this regard. It's certainly possible to use Tor with IPFS to protect your IP address but this is WIP. https://github.com/hashmatter/libp2p-onion-routing Openbazaar, which uses IPFS can run as a hidden service https://github.com/OpenBazaar/openbazaar-go/blob/master/docs...

Re: New improvements to IPFS Bitswap for faster container image distribution

#35
post #11
post #6

Netflix use IPFS? That's quite an endorsement and makes me take it a lot more seriously.

”Netflix and IPFS began collaborating on ways to incorporate peer-to-peer services into Netflix’s developer tooling” Developer tooling is a pretty limited part of their traffic probably

The volume of traffic doesn't really matter that much. Developer productivity is just as important as the service you're actually selling when you're the size of Netflix. If your N thousand engineers are suddenly unable to work, or slowed down by X%, that's a huge problem. Large companies treat (or should treat) developer tooling issues as seriously as application outages.

If Netflix is using IPFS for anything worth mentioning, it's almost certainly substantive enough to be considered an endorsement.

Re: New improvements to IPFS Bitswap for faster container image distribution

#36

Saving Netflix's bandwith costs by sacrificing your privacy. IPFS and bittorrent don't do anything to protect the data you are uploading and your IP address. Case in point: https://iknowwhatyoudownload.com/en/peer/ Now every website you visit, any ad/tracker, any homecalling phone app can tell what movies and contents you watch and when you are at home. For years.

Do not visit this site. If you visit it once and then visit it after a while they will fill it with crap that you did not download in order to blackmail you or something I presume. Alternatively they might start tracking you only once you visit it. Even if they are honest it is extremely inaccurate (it had 8.8.8.8 torrenting anime a while ago for example)

Re: New improvements to IPFS Bitswap for faster container image distribution

#37

Saving Netflix's bandwith costs by sacrificing your privacy. IPFS and bittorrent don't do anything to protect the data you are uploading and your IP address. Case in point: https://iknowwhatyoudownload.com/en/peer/ Now every website you visit, any ad/tracker, any homecalling phone app can tell what movies and contents you watch and when you are at home. For years.

Do not visit this site. If you visit it once and then visit it after a while they will fill it with crap that you did not download in order to blackmail you or something I presume. Alternatively they might start tracking you only once you visit it. Even if they are honest it is extremely inaccurate (it had 8.8.8.8 torrenting anime a while ago for example)

Bogus results can simply be the result of ISP IP address recycling which, in my case, is pretty obvious. Besides, why would they wait on an IP address visit to fill it with blackmail material? The suspicion doesn't make much sense to me.

Re: New improvements to IPFS Bitswap for faster container image distribution

#39
One big optimization that could help in some cases for container platforms like Fargate is not downloading the entire image just to run the container. Instead read files (or even just blocks) from network storage on demand.

This is basically how booting from a disk image works on most cloud platforms too.

Re: New improvements to IPFS Bitswap for faster container image distribution

#40
post #26

I really don't understand why there is a big hype towards IPFS which is still in development stage although, there are other options which are already out and working like Sia - Skynet which is not even getting a fraction of attention IPFS is getting.

Skynet is barely two weeks old fwiw. As more people play around with it and see how strong it is I think it'll get a lot more attention. Lot of crypto projects are already planning to add support in the coming months.
Post reply on HN