Supabase Storage now supports the S3 protocol
supabase.com
Supabase Storage now supports the S3 protocol
1–10 of 194 posts
Re: Supabase Storage now supports the S3 protocol
#2hey hn, supabase ceo here
For background: we have a storage product for large files (like photos, videos, etc). The storage paths are mapped into your Postgres database so that you can create per-user access rules (using Postgres RLS)
This update adds S3 compatibility, which means that you can use it with thousands of tools that already support the protocol.
I'm also pretty excited about the possibilities for data scientists/engineers. We can do neat things like dump postgres tables in to Storage (parquet) and you can connect DuckDB/Clickhouse directly to them. We have a few ideas that we'll experiment with to make this easy
Let us know if you have any questions - the engineers will also monitor the discussion
Re: Supabase Storage now supports the S3 protocol
#3Here is the example of the DuckDB querying parquet files directly from Storage because it supports the S3 protocol now - https://github.com/TylerHillery/supabase-storage-duckdb-demo
Re: Supabase Storage now supports the S3 protocol
#4Dear supabase. Please don’t get bought out by anyone and ruined. I’ve built too many websites with a supabase backend now to go back.
Re: Supabase Storage now supports the S3 protocol
#5I tried to migrate from Firebase once and it wasn't really straightforward and decided against doing it, I think you guys (if you haven't already) should make migration plugins a first class priority that "just works" as the amount of real revenue generating production projects on Firebase and similar are of a much higher number. It's a no-brainer that many of them may want to switch if it were safe and simple to do so.
Re: Supabase Storage now supports the S3 protocol
#6Shouldn't it be API rather than protocol?
Also my sympathies for having to support the so-called "S3 standard/protocol".
Re: Supabase Storage now supports the S3 protocol
#7Dear supabase. Please don’t get bought out by anyone and ruined. I’ve built too many websites with a supabase backend now to go back.
we don't have any plans to get bought.
we only have plans to keep pushing open standards/tools - hopefully we have enough of a track record here that it doesn't feel like lip service
Re: Supabase Storage now supports the S3 protocol
#8I tried to migrate from Firebase once and it wasn't really straightforward and decided against doing it, I think you guys (if you haven't already) should make migration plugins a first class priority that "just works" as the amount of real revenue generating production projects on Firebase and similar are of a much higher number. It's a no-brainer that many of them may want to switch if it were safe and simple to do…
we have some guides (eg: https://supabase.com/docs/guides/resources/migrating-to-supa...)
also some community tools: https://github.com/supabase-community/firebase-to-supabase
we often help companies migrating from firebase to supabase - usually they want to take advantage of Postgres with similar tooling.
Re: Supabase Storage now supports the S3 protocol
#9Friendly reminder that Supabase is really cool, and if you haven't tried it out you should do it (everything can be self hosted and they have generous free tiers!)
Re: Supabase Storage now supports the S3 protocol
#10A question about implementation, is the data really stored in a Postgres database? Do you support transactional updates like atomically updating two files at once?
Is there a Postgres storage backend optimized for storing large files?