Live data from Hacker News

Cloudflare’s Zero Egress Fee Object Storage, R2, Is Now GA

blog.cloudflare.com

31–35 of 35 posts

Re: Cloudflare’s Zero Egress Fee Object Storage, R2, Is Now GA

#31
post #12

While conceptually I love the idea of not having to explicitly set the region of an object I'm storing, I feel like (especially in a distributed team or product) this could end up with a mishmash of data distributed all over the place with a bunch of different and unpredictable access time and latency characteristics. Maybe the solution here is "just make sure the asset is cached on the edge" but for first access the…

If you can cache your assets then the region typically doesn't matter too much (depending on workload). That being said, I put up a spec to let you provide hints. We won't necessarily honor it today in some cases and in the future we may ignore it altogether, but the thinking is you provide the hint & can retrieve which geographic region the bucket is in. We also have latency improvements coming down the pipe.

Vitali, how does serving directly from R2 via https work right now under the hood?

Is the data replicated across geos?

Does all or a portion of it get cached at a local edge once requested?

Does it basically behave as if it was handled by CF cache?

These parts are really confusing for me right now.

Re: Cloudflare’s Zero Egress Fee Object Storage, R2, Is Now GA

#34
post #25

Loving R2. I am having an issue of uploading larger files though, like 100MB+. The error I get is: Unable to write file at location: JrF3FnkA9W.webm. An exception occurred while uploading parts to a multipart upload. The following parts had errors: - Part 17: Error executing "UploadPart" on {URL} with the message: "Reduce your concurrent request rate for the same object." Is this an issue on my end or CloudFlare's? I…

Known issue. Currently multipart uploads can only be uploaded at 2 parts per upload ID concurrently. We have a fix pending that should fix that bottleneck within the next month or so (maybe sooner). The change will show up on https://developers.cloudflare.com/r2/platform/changelog/ For now there are typically settings you can configure in whatever client you're using to lower the concurrency for uploads.

Hey does this mean there's currently a max upload size of 1GB since each part can only be 500MB and you can only upload in 2 parts?

Re: Cloudflare’s Zero Egress Fee Object Storage, R2, Is Now GA

#35

Earlier quoted context omitted.

Known issue. Currently multipart uploads can only be uploaded at 2 parts per upload ID concurrently. We have a fix pending that should fix that bottleneck within the next month or so (maybe sooner). The change will show up on https://developers.cloudflare.com/r2/platform/changelog/ For now there are typically settings you can configure in whatever client you're using to lower the concurrency for uploads.

Hey does this mean there's currently a max upload size of 1GB since each part can only be 500MB and you can only upload in 2 parts?

To answer my question the answer is no, this is about concurrent requests, so it's 2 at once but it will do upto 500 for each as many times as it needs to, to upload a 20GB file.
Post reply on HN