Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Supabase Storage now supports the S3 protocol

supabase.com

Post reply on HN
Print view View original

11–20 of 194 posts

Re: Supabase Storage now supports the S3 protocol

#11

Post by fenos »

gime_tree_fiddy wrote: post #6

Shouldn't it be API rather than protocol? Also my sympathies for having to support the so-called "S3 standard/protocol".

Yes, both can be fine :) after all, a Protocol can be interpreted as a Standardised API which the client and server interact with, it can be low-level or high-level.

I hope you like the addition and we have the implementation all open-source on the Supabase Storage server

Re: Supabase Storage now supports the S3 protocol

#12

Post by kiwicopple »

denysvitali wrote: post #9

Friendly reminder that Supabase is really cool, and if you haven't tried it out you should do it (everything can be self hosted and they have generous free tiers!)

thanks for taking time to make a comment. it's nice to get some kind words between the feedback (which we also like)

Re: Supabase Storage now supports the S3 protocol

#13

Post by isoprophlex »

denysvitali wrote: post #9

Friendly reminder that Supabase is really cool, and if you haven't tried it out you should do it (everything can be self hosted and they have generous free tiers!)

Plus, with all the inflated vc money fueled hype on vector databases, they seem to have the only offering in this space that actually makes sense to me. With them you can store your embeddings close to all the rest of your data, in a single postgres db.

Re: Supabase Storage now supports the S3 protocol

#14

Post by preommr »

gime_tree_fiddy wrote: post #6

Shouldn't it be API rather than protocol? Also my sympathies for having to support the so-called "S3 standard/protocol".

I think that protocol is appropriate here since s3 resources are often represented by a s3:// url where the scheme part of the url is often used to represent the protocol.

Re: Supabase Storage now supports the S3 protocol

#16

Post by fenos »

nextaccountic wrote: post #10

A question about implementation, is the data really stored in a Postgres database? Do you support transactional updates like atomically updating two files at once? Is there a Postgres storage backend optimized for storing large files?

We do not store the files in Postgres, the files are stored in a managed S3 bucket.

We store the metadata of the objects and buckets in Postgres so that you can easily query it with SQL. You can also implement access control with RLS to allow access to certain resources.

It is not currently possible to guarantee atomicity on 2 different file uploads since each file is uploaded on a single request, this seems a more high-level functionality that could be implemented at the application level

Re: Supabase Storage now supports the S3 protocol

#18

Post by ntry01 »

This is great news, and I agree with everyone in the thread - Supabase is a great product.

Does this mean that Supabase (via S3 protocol) supports file download streaming using an API now?

As far as I know, it was not achievable before and the only solution was to create a signed URL and stream using HTTP.

Re: Supabase Storage now supports the S3 protocol

#19

Post by fenos »

ntry01 wrote: post #18

This is great news, and I agree with everyone in the thread - Supabase is a great product. Does this mean that Supabase (via S3 protocol) supports file download streaming using an API now? As far as I know, it was not achievable before and the only solution was to create a signed URL and stream using HTTP.

Yes, absolutely! You can download files as streams and make use of Range requests too.

The good news is that the Standard API is also supporting stream!

Post reply on HN