Earlier quoted context omitted.
If it is indeed 300* faster, I'm sure more rational corporations will rethink their license policy or be left in the dust.
They could simply spend a few months and a few million tokens and get their own port, no? I doubt even 30000x faster would prompt a policy change.
Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
31–40 of 168 posts
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#32Author here. Let me know if you have any questions about the post or about pgrust. Let me take a shot at answering what I think will be the most common question: how can I trust pgrust? Our #1 priority right now is correctness. Over the past two weeks, I've done a mix of formal verification and differential fuzz testing. We've been able to prove over 1000 user facing functions have the exact same logic in both pgrust…
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#33Earlier quoted context omitted.
Oh bummer. I was really excited about pgrust but AGPL is a dealbreaker. Not for me personally, but it will never see wide adoption because it’s a banned license in most corporate environments. Lack of path to wide adoption means it’s dead in the water. It’s weird because those who actually care about optimized pg gains are most likely large corporate customers. Why make a product targeting them and license it in such…
If it is indeed 300* faster, I'm sure more rational corporations will rethink their license policy or be left in the dust.
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#34Earlier quoted context omitted.
They could simply spend a few months and a few million tokens and get their own port, no? I doubt even 30000x faster would prompt a policy change.
Are you suggesting the AI just rewrites the whole thing under a different license? There’s no way that’s not more dicey than the AGPL license.
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#35Author here. Let me know if you have any questions about the post or about pgrust. Let me take a shot at answering what I think will be the most common question: how can I trust pgrust? Our #1 priority right now is correctness. Over the past two weeks, I've done a mix of formal verification and differential fuzz testing. We've been able to prove over 1000 user facing functions have the exact same logic in both pgrust…
what is your vision of this project? Do you think pgrust will eventually be prod ready?
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#36Earlier quoted context omitted.
If it is indeed 300* faster, I'm sure more rational corporations will rethink their license policy or be left in the dust.
They could simply spend a few months and a few million tokens and get their own port, no? I doubt even 30000x faster would prompt a policy change.
Also, you can successfully sell a systems project that is only 10% faster. 30000x faster and they are throwing illegal and debauched things through your window to get access to your improvements.
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#37Earlier quoted context omitted.
Oh bummer. I was really excited about pgrust but AGPL is a dealbreaker. Not for me personally, but it will never see wide adoption because it’s a banned license in most corporate environments. Lack of path to wide adoption means it’s dead in the water. It’s weird because those who actually care about optimized pg gains are most likely large corporate customers. Why make a product targeting them and license it in such…
If it is indeed 300* faster, I'm sure more rational corporations will rethink their license policy or be left in the dust.
PS Learn how DBs do joins for more information. Specifically the differences between hash joins, merge joins and nested loop joins. They are basically fancy ways to page part of your working set to disk at huge performance penalties.
PPS As memory gets more expensive, these techniques get more valuable. When it gets cheap, they lose value.
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#38Author here. Let me know if you have any questions about the post or about pgrust. Let me take a shot at answering what I think will be the most common question: how can I trust pgrust? Our #1 priority right now is correctness. Over the past two weeks, I've done a mix of formal verification and differential fuzz testing. We've been able to prove over 1000 user facing functions have the exact same logic in both pgrust…
A question on 20s postgresql time - It does not look like you are accounting for reading data from disk? Wouldn't the aggregation query have to load data from disk first? Or is it somewhat guaranteed that the table is already in memory? The Rust version is clearly in memory (I am no rust expert, so that may not even be actually in memory, if its a generator).
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#39Earlier quoted context omitted.
If it is indeed 300* faster, I'm sure more rational corporations will rethink their license policy or be left in the dust.
License policies are made by lawyers not by programmers. And their competition will be in the exact same boat (different lawyers though). AGPL is so toxic that it tends to be checked for during M&A processes so even if the current batch of lawyers is ok with it there is a chance that a later batch of lawyers is not. Given that the target audience for this project is the larger companies you are going to end up with a…
Re: Making Postgres 300x faster for analytics: batching, operator fusion, and SIMD
#40pgrust seems to have good momentum. AGPL is an odd license for a non web project. Postgres is MIT-like, and that drove it's adoption. Have pgrust folks reconsidered this? Else, IMO we can have an independant rust port of pgrust, which can be MIT, which will garner more attention.
Oh bummer. I was really excited about pgrust but AGPL is a dealbreaker. Not for me personally, but it will never see wide adoption because it’s a banned license in most corporate environments. Lack of path to wide adoption means it’s dead in the water. It’s weird because those who actually care about optimized pg gains are most likely large corporate customers. Why make a product targeting them and license it in such…
Wait, sorry, you're asking why make something enterprise customers might pay for, and then not give it away to them for free?