Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Supabase Storage now supports the S3 protocol

supabase.com

Post reply on HN
Print view View original

31–40 of 194 posts

Re: Supabase Storage now supports the S3 protocol

#31

Post by kiwicopple »

filleokus wrote: post #29

Do you think Supabase Storage (now or in the future) could be an attractive standalone S3 provider as an alternative to e.g MinIO?

It's more of a "accessibility layer" on top of S3 or any other s3-compatible backend (which means that it also works with MinIO out-of-the-box [0])

I don't think we'll ever build the underlying storage layer. I'm a big fan of what the Tigris[1] team have built if you're looking for other good s3 alternatives

[0] https://github.com/supabase/storage/blob/master/docker-compo...

[1] Tigris: https://tigrisdata.com

Re: Supabase Storage now supports the S3 protocol

#32

Post by avodonosov »

fenos wrote: post #30
avodonosov wrote: post #27

The article does not mention: do you support pre-signed URLs? https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-...

Thanks for asking this, we do not support signed URLs just yet, but it will be added in the next iteration

Presigned URLs are useful because client app can upload/download directly from S3, saving the app server from this traffic. Does Row-Level Security achieve the same benefit?

Re: Supabase Storage now supports the S3 protocol

#33

Post by jonplackett »

kiwicopple wrote: post #7
jonplackett wrote: post #4

Dear supabase. Please don’t get bought out by anyone and ruined. I’ve built too many websites with a supabase backend now to go back.

we don't have any plans to get bought. we only have plans to keep pushing open standards/tools - hopefully we have enough of a track record here that it doesn't feel like lip service

Absolutely. I am so impressed with SB. It’s like you read my mind and then make what I’ll need before I realise.

(This is not a paid promotion)

Re: Supabase Storage now supports the S3 protocol

#34

Post by gherkinnn »

jonplackett wrote: post #4

Dear supabase. Please don’t get bought out by anyone and ruined. I’ve built too many websites with a supabase backend now to go back.

This is my biggest reservation towards Supabase. Google bought Firebase in 2014. I've seen Vercel run Nextjs in to the ground and fuck up their pricing for some short-term gains. And Figma almost got bought by Adobe. I have a hard time trusting products with heavy VC backing.

Re: Supabase Storage now supports the S3 protocol

#35

Post by kiwicopple »

jonplackett wrote: post #33
kiwicopple wrote: post #7

Earlier quoted context omitted.

we don't have any plans to get bought. we only have plans to keep pushing open standards/tools - hopefully we have enough of a track record here that it doesn't feel like lip service

Absolutely. I am so impressed with SB. It’s like you read my mind and then make what I’ll need before I realise. (This is not a paid promotion)

>like you read my mind

we receive a lot of community feedback and ultimately there are only a few "primitives" developers need to solve 90% of their problems

I think we're inching closer to the complete set of primitives which can be used to combine into second-order primitives (eg: queues/search/maps can all be "wrappers" around the primitives we already provide)

Re: Supabase Storage now supports the S3 protocol

#36

Post by yoavm »

This looks great! How easy is it to self host Supabase? Is it more like "we're open-source, but good luck getting this deployed!", or can someone really build on Supabase and if things get a little too expensive it's easy enough to self-host the whole thing and just switch over? I wonder if people are doing that.

Re: Supabase Storage now supports the S3 protocol

#37

Post by devjume »

This is great news. Now I can utilize any CDN provider that supports S3. Like bunny.net [1] which has image optimization, just like Supabase does but with better pricing and features.

I have been developing with Supabase past two months. I would say there are still some rough corners in general and some basic features missing. Example Supabase storage has no direct support for metadata [2][3].

Overall I like the launch week and development they are doing. But more attention to basic features and little details would be needed because implementing workarounds for basic stuff is not ideal.

[1] https://bunny.net/ [2] https://github.com/orgs/supabase/discussions/5479 [3] https://github.com/supabase/storage/issues/439

Re: Supabase Storage now supports the S3 protocol

#38

Post by fenos »

avodonosov wrote: post #32
fenos wrote: post #30

Earlier quoted context omitted.

Thanks for asking this, we do not support signed URLs just yet, but it will be added in the next iteration

Presigned URLs are useful because client app can upload/download directly from S3, saving the app server from this traffic. Does Row-Level Security achieve the same benefit?

Yes, I agree! Although I should have specified that we support signed URL https://supabase.com/docs/reference/javascript/storage-from-... just not in the S3 protocol just yet :)

Re: Supabase Storage now supports the S3 protocol

#39

Post by kiwicopple »

nextaccountic wrote: post #28
fenos wrote: post #16

Earlier quoted context omitted.

We do not store the files in Postgres, the files are stored in a managed S3 bucket. We store the metadata of the objects and buckets in Postgres so that you can easily query it with SQL. You can also implement access control with RLS to allow access to certain resources. It is not currently possible to guarantee atomicity on 2 different file uploads since each file is uploaded on a single request, this seems a more h…

Oh. So this is like, S3 on top of S3? That's interesting.

in case it's not clear why this is required, some of the things the storage engine handles are:

image transformations, caching, automatic cache-busting, multiple protocols, metadata management, postgres compatibility, multipart uploads, compatibility across storage backends, etc

Re: Supabase Storage now supports the S3 protocol

#40

Post by fenos »

nextaccountic wrote: post #28
fenos wrote: post #16

Earlier quoted context omitted.

We do not store the files in Postgres, the files are stored in a managed S3 bucket. We store the metadata of the objects and buckets in Postgres so that you can easily query it with SQL. You can also implement access control with RLS to allow access to certain resources. It is not currently possible to guarantee atomicity on 2 different file uploads since each file is uploaded on a single request, this seems a more h…

Oh. So this is like, S3 on top of S3? That's interesting.

Yes indeed! I would call it S3 on steroids!

Currently, it happens to be S3 to S3, but you could write an adapter, let's say GoogleCloudStorage and it will become S3 -> GoogleCloudStorage, or any other type of underline Storage.

Additionally, we provide a special way of authenticating to Supabase S3 using the SessionToken, which allows you to scope S3 operations to your users specific access control

https://supabase.com/docs/guides/storage/s3/authentication#s...

Post reply on HN