Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Supabase Storage v3: Resumable Uploads with support for 50GB files

supabase.com

Post reply on HN
Print view View original

51–58 of 58 posts

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#51

Post by kiwicopple »

joshspankit wrote: post #47
kiwicopple wrote: post #45

Earlier quoted context omitted.

yes, it's planned. I believe the only blocker we saw last time we looked was a 1-hour downtime-window every week (not that always went offline, but that they could use that time for maintenance). Do you know if that's still the case?

If you’re talking about https://www.backblaze.com/scheduled-maintenance.html it’s not intended to affect file usage of B2 (the bucket functions may go offline for up to 15min, but ul, dl, and listing of files are fine. One related thing to be aware of: the official documentation suggests adding retry to every file upload as some uploads naturally fail (usually for load balancing))

yes, I believe that is the one. We've engineered the server for additional providers and so it should be easy enough to add (and we'd welcome any PRs)

one caveat - we are shipping as fast as we can right now so that we can have feature-parity with Firebase. It's a balance of "breadth vs depth" and right now we are going for breadth. We will definitely offer more providers on the platform but the resilience of s3 is beneficial for our engineers right now - it means that they can focus on features rather than devops.

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#52

Post by sickcodebruh »

kiwicopple wrote: post #50
sickcodebruh wrote: post #46

Earlier quoted context omitted.

This was almost exactly my trajectory. It’s a shame cause Supabase is so close to being a slam dunk for me but this complicates it. Are you using S3 for storage or were you able to stick with Supabase and use upload complete callbacks to trigger the lambda?

that's great feedback. Our Functions team has seen this - we'll see what we can do

Thank you! This was one of the two major blockers for me, the other being lack of presigned upload URLs and I see that landed with this release!

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#53

Post by scrollaway »

kiwicopple wrote: post #2

hey hn, supabase ceo here This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support. As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops o…

Quick question; since you use AWS under the hood, is there any way to “bring your own aws account” for any of these things? (Example use cases: relevant if I want to use sns alongside your storage solutions, or if I have aws credits I want to use)

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#54

Post by jmholla »

kiwicopple wrote: post #14
mplemay wrote: post #11

Earlier quoted context omitted.

Thanks for working on such an awesome project and releasing such useful features! Yet, what stops us from using supabase is not the set of features, but the state of the current apis. Last night I was evaluating the python sdk and some of the examples were broken, baseline features like RLS are unimplemented ( https://github.com/supabase-community/supabase-py/issues/58 ), and progress seems slow (it seems to have bee…

client libs are one of our next focuses. we've been discussing internally how to do this. So far we have concentrated on the JS/Dart libs because that makes up a large portion of our users. Over the last 3 months the community has added (and documented) libraries for Swift[0] and C#[0]. We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of…

> We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of the libraries (especially Python), please reach out. If we can't find maintainers we'll find a polyglot who can work on this full-time.

Are these types of positions paid?

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#55

Post by LoganDark »

bachmeier wrote: post #38
kiwicopple wrote: post #14

Earlier quoted context omitted.

client libs are one of our next focuses. we've been discussing internally how to do this. So far we have concentrated on the JS/Dart libs because that makes up a large portion of our users. Over the last 3 months the community has added (and documented) libraries for Swift[0] and C#[0]. We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of…

> So far we have concentrated on the JS/Dart libs because that makes up a large portion of our users. I once had a computer magazine publisher tell me they only published Windows content because none of their readers used Mac or Linux.

It sounds similar to how my ISP only offers 25mbps upload to go with 900mbps download because "none of our customers use any more than 25mbps".

Of course they won't use more than 25mbps if you literally throttle them to that speed. What a joke.

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#56

Post by kiwicopple »

scrollaway wrote: post #53
kiwicopple wrote: post #2

hey hn, supabase ceo here This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support. As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops o…

Quick question; since you use AWS under the hood, is there any way to “bring your own aws account” for any of these things? (Example use cases: relevant if I want to use sns alongside your storage solutions, or if I have aws credits I want to use)

not yet, but this is something we will work on (probably next year)

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#57

Post by kiwicopple »

jmholla wrote: post #54
kiwicopple wrote: post #14

Earlier quoted context omitted.

client libs are one of our next focuses. we've been discussing internally how to do this. So far we have concentrated on the JS/Dart libs because that makes up a large portion of our users. Over the last 3 months the community has added (and documented) libraries for Swift[0] and C#[0]. We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of…

> We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of the libraries (especially Python), please reach out. If we can't find maintainers we'll find a polyglot who can work on this full-time. Are these types of positions paid?

yes, we pay maintainers. See "giving back" in our blog post from last year:

https://supabase.com/blog/supabase-series-b

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#58

Post by vamega »

fenospro wrote: post #31
vamega wrote: post #27

Looking through the supabase storage docs, I wasn't able to identify if storing to local disk was an option? I know it launched with S3 as a supported backend, but I'm curious to know if this ever expanded. Or perhaps supporting Minio as a backend, which I could run on the same machine.

Hey, Supabase Storage engineer here Yes, we support S3, Minio and any S3 compatible storage servers. As well as the File System (local disk) - This is for the self hosted version. When using Supabsase managed version we are storing your files in a S3 bucket managed by us

The local disk option when self hosted is what I was looking for. Couldn’t see that mentioned in any of the docs.

This looks great! Thank you

Post reply on HN