Why is this better than loki?
https://github.com/Logflare/logflare/blob/staging/LICENSE.md for one thing
What's wrong with https://github.com/grafana/loki/blob/main/LICENSE?
Supabase Logs: open-source logging server
61–68 of 68 posts
Re: Supabase Logs: open-source logging server
#62Re: Supabase Logs: open-source logging server
#63Earlier quoted context omitted.
Hi, You mentioned above that BigQuery reduces cost. I am surprised by that assertion, tbh. Can you point out ways in which Logflare uses it that makes it so (for ex, is it tiered-storage with a BQ front-end)? How does Logflare's approach contrast with other entrants like axiom.co/99 who are leveraging blob stores (Cloudflare R2) for storage and serverless for querying for lower costs? Multiple pluggable storage/query…
Great questions. BigQuery reduces storage costs as even before their recent pricing change, the cost per GB [0] is on par with and slightly lower than s3 storage costs [0], which we can use as a estimated market price for data storage. BigQuery makes money off the querying costs, which we take steps to optimize and minimize, with table partitions, caching, and ui design, both client side and server side. These all he…
Yeah, thanks to you both! (:
Re: Supabase Logs: open-source logging server
#64What are some of the largest production applications built using Supabase? I know it's popular for whipping something up for a hackathon, but how battle tested is it? Also does anybody know what they're doing behind the scenes with the database? I know their storage uses s3, functions (I think) use Deno, this uses BigQuery. Is their db on RDS/Aurora? If so how do they claim max DB size of 1024 TB while Aurora is 128…
- Storage: s3 - Database: EC2 t4g - Functions: Deno We have tens-of-thousands of applications using Supabase in production. "Size" is a hard one to answer because it means different things to different people. We have projects that have databases and storage in the hundreds-of-terrabytes, projects making millions of API requests, and logos from Fortune 100 companies.
*hundreds-of-gigabytes - not terabytes. apologies, I’m responding too fast this week, and don’t want to mislead anyone
Re: Supabase Logs: open-source logging server
#65Earlier quoted context omitted.
- Storage: s3 - Database: EC2 t4g - Functions: Deno We have tens-of-thousands of applications using Supabase in production. "Size" is a hard one to answer because it means different things to different people. We have projects that have databases and storage in the hundreds-of-terrabytes, projects making millions of API requests, and logos from Fortune 100 companies.
*hundreds-of-gigabytes - not terabytes. apologies, I’m responding too fast this week, and don’t want to mislead anyone
How do you claim max DB size of 1024TB, are you guys using Citus? Would the user need to handle partitioning etc at that size?
Re: Supabase Logs: open-source logging server
#66Earlier quoted context omitted.
*hundreds-of-gigabytes - not terabytes. apologies, I’m responding too fast this week, and don’t want to mislead anyone
How do you claim max DB size of 1024TB, are you guys using Citus? Would the user need to handle partitioning etc at that size?
That is a now incorrect, and I will get the team to correct it. The max is 64TB (the size of a EBS volume, https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/volume_c...)
Thank you for pointing it out
Re: Supabase Logs: open-source logging server
#67Earlier quoted context omitted.
Hi, You mentioned above that BigQuery reduces cost. I am surprised by that assertion, tbh. Can you point out ways in which Logflare uses it that makes it so (for ex, is it tiered-storage with a BQ front-end)? How does Logflare's approach contrast with other entrants like axiom.co/99 who are leveraging blob stores (Cloudflare R2) for storage and serverless for querying for lower costs? Multiple pluggable storage/query…
> Can you point out ways in which Logflare uses it that makes it so (for ex, is it tiered-storage with a BQ front-end)? After 3 months BigQuery storage ends up being about half the cost of object storage if you use partitioned tables and don't edit the data. > How does Logflare's approach contrast with other entrants like axiom.co/99 who are leveraging blob stores (Cloudflare R2) for storage and serverless for queryi…
> After 3 months BigQuery storage ends up being about half the cost of object storage if you use partitioned tables and don't edit the data.
It sounds like it's just standard GCS nearline pricing plus BigQuery margin fee. Raw nearline is cheaper to store, but has a per-GB access fee that'll hurt if you re-process old logs.
Interestingly, BigQuery's streaming read free tier of 300 TB/mo makes BigQuery a fun hack to store your old-but-read-more data into, even if it's e.g. backups blobs.
Re: Supabase Logs: open-source logging server
#68I weep a bit every time I see a new Supabase capability knowing I'm stuck on Firebase.
Given that Logflare is a feature independent from supabase seems like you can use the logs independently if you wish!