Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Supabase Storage v3: Resumable Uploads with support for 50GB files

supabase.com

Post reply on HN
Print view View original

11–20 of 58 posts

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#11

Post by mplemay »

kiwicopple wrote: post #2

hey hn, supabase ceo here This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support. As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops o…

Thanks for working on such an awesome project and releasing such useful features!

Yet, what stops us from using supabase is not the set of features, but the state of the current apis. Last night I was evaluating the python sdk and some of the examples were broken, baseline features like RLS are unimplemented (https://github.com/supabase-community/supabase-py/issues/58), and progress seems slow (it seems to have been release two years ago and it is still in alpha). Even though supporting many platforms is boring (i.e. no flashy feature announcements) and costly (many FTEs are required for maintenance let alone adding features), are there any plans to bring feature parity more of the sdks to allow more developers to leverage this awesome platform?

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#13

Post by waboremo »

no_wizard wrote: post #6
Whiteshadow12 wrote: post #4

This team ships, every few years, there is a company HN loves, few years ago it was CloudFlare/Stripe, Supabase feels to be in the same class. Linear as well.

Supabase and Linear do deserve the hype IMO and Cloudflare still does. Stripe has gotten a bit more iffy for me, with some of their poor practices around frozen accounts

Cloudflare and Stripe have just reached that stage where there isn't much to hype about. They're now dealing with problems that are gnarly, as opposed to "we just launched a storage service!" Not to diminish Supabase, Fly, etc. and their tremendous work, it's just a completely different lane of expectations.

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#14

Post by kiwicopple »

mplemay wrote: post #11
kiwicopple wrote: post #2

hey hn, supabase ceo here This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support. As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops o…

Thanks for working on such an awesome project and releasing such useful features! Yet, what stops us from using supabase is not the set of features, but the state of the current apis. Last night I was evaluating the python sdk and some of the examples were broken, baseline features like RLS are unimplemented ( https://github.com/supabase-community/supabase-py/issues/58 ), and progress seems slow (it seems to have bee…

client libs are one of our next focuses. we've been discussing internally how to do this. So far we have concentrated on the JS/Dart libs because that makes up a large portion of our users. Over the last 3 months the community has added (and documented) libraries for Swift[0] and C#[0].

We hope to continue making this a community-driven endeavor, so if anyone reading this would like to become a maintainer for one of the libraries (especially Python), please reach out. If we can't find maintainers we'll find a polyglot who can work on this full-time.

[0] Swift: https://supabase.com/docs/reference/swift/introduction

[1] C#: https://supabase.com/docs/reference/csharp/introduction

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#15

Post by sickcodebruh »

Supabase looks so good and keeps getting better. I started playing with it a couple months ago and could see myself loving it. One of my biggest problems right now is inertia: I’m comfortable with my existing tools (RDS, S3, lambda) and thinking about building a new product while also adding new tools is a tough pill to swallow. But the product sure makes a strong case!

Resumable uploads is a big deal for what I’m working on. But I’m also blocked by another issue, maybe a Supabase engineer on the thread can weight in. I’m using ffmpeg on AWS lambda to transcode media files after successful upload to S3. Lambda makes it easy to add ffmpeg binaries via lambda layers. Supabase functions don’t seem to provide any such option. Is there a way to solve this within Supabase as it exists now?

I’m also curious about function timeouts. If I have a file conversion that takes a couple minutes, is a Supabase function the right way to go?

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#16

Post by debarshri »

sickcodebruh wrote: post #15

Supabase looks so good and keeps getting better. I started playing with it a couple months ago and could see myself loving it. One of my biggest problems right now is inertia: I’m comfortable with my existing tools (RDS, S3, lambda) and thinking about building a new product while also adding new tools is a tough pill to swallow. But the product sure makes a strong case! Resumable uploads is a big deal for what I’m wo…

That is the same inertia we see while selling to early stage company.

I also see quite some people build out in supabase and migrate to AWS, especially if they want SOC2 or some compliance certifications. The Compliance automation tools work really well with known cloud providers.

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#17

Post by subpar »

sickcodebruh wrote: post #15

Supabase looks so good and keeps getting better. I started playing with it a couple months ago and could see myself loving it. One of my biggest problems right now is inertia: I’m comfortable with my existing tools (RDS, S3, lambda) and thinking about building a new product while also adding new tools is a tough pill to swallow. But the product sure makes a strong case! Resumable uploads is a big deal for what I’m wo…

I was trying to do the same thing (ffmpeg to do file transformations on upload) and couldn't figure it out with Supabase functions. After poking around in the Deno discord for awhile, it seems that ffmpeg.wasm for Deno just isn't much of a thing yet. I was able to get it working with Vercel functions, but it was a total nightmare and the runtime made it a non-starter. I landed where you started: just do it in Lambda!

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#18

Post by kiwicopple »

sickcodebruh wrote: post #15

Supabase looks so good and keeps getting better. I started playing with it a couple months ago and could see myself loving it. One of my biggest problems right now is inertia: I’m comfortable with my existing tools (RDS, S3, lambda) and thinking about building a new product while also adding new tools is a tough pill to swallow. But the product sure makes a strong case! Resumable uploads is a big deal for what I’m wo…

> Is there a way to solve this within Supabase as it exists now?

No, not right now. However we do have a planned path to this. The 3 features we will release are:

1. Custom execution limits/timeouts for Edge Functions.

2. WASM support in Edge Functions

3. Storage Webhooks, which can trigger an Edge Functions

Features 1 & 2 will be possible with the Edge Runtime we released yesterday[0]. Feature 3 is already possible using our Postgres Database Webhooks[1], and we will also provide additional support for this directly in the storage server

[0] Edge Runtime discussion: https://news.ycombinator.com/item?id=35525222

[1] Postgres Database Webhooks: https://supabase.com/docs/guides/database/webhooks

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#19

Post by traceroute66 »

paulgb wrote: post #8
Whiteshadow12 wrote: post #4

This team ships, every few years, there is a company HN loves, few years ago it was CloudFlare/Stripe, Supabase feels to be in the same class. Linear as well.

I'd add Tailscale and Fly.io to the category, too. Well-written technical blogs are truly the way to HN's heart.

> Fly.io ... well-written technical blogs

I'm not sure I would class fly.io as well-written technical blogs. Well-written yes, technical no.

I used to think the fly.io ones were good, but having read a good few of them I've found they follow the same repetitive structure:

    - Very light on detail (fly.io blogs are carefully written to *sound* like they're giving you detail, but in reality it's all a 50,000ft view, and a lightweight one at that.  Given the length of their average blog post, they could and should do better.).
    - Constantly going off-tangent, whether randomly talking about sandwich fillings, food-types, or just a paragraph with the author's rant about how they dislike a particular technology.  The first couple of times its cute, but after that, not so much ...

Re: Supabase Storage v3: Resumable Uploads with support for 50GB files

#20

Post by mrkurt »

traceroute66 wrote: post #19
paulgb wrote: post #8

Earlier quoted context omitted.

I'd add Tailscale and Fly.io to the category, too. Well-written technical blogs are truly the way to HN's heart.

> Fly.io ... well-written technical blogs I'm not sure I would class fly.io as well-written technical blogs. Well-written yes, technical no. I used to think the fly.io ones were good, but having read a good few of them I've found they follow the same repetitive structure: - Very light on detail (fly.io blogs are carefully written to *sound* like they're giving you detail, but in reality it's all a 50,000ft view, and…

Would you mind sharing specifics about the first bullet? What's the last post you read you thought could have gone deeper? We definitely want to go deep, some of our posts are better than others.
Post reply on HN