I am excited to see Databricks turn into the next Oracle. This type of acquisition was inevitable. The king is dead! Long live the king!
And yes, congratulations to the Neon team! (Nikita is, after all, YC)
Databricks acquires Neon
141–150 of 234 posts
Re: Databricks acquires Neon
#142Earlier quoted context omitted.
Try expanding a cluster, or changing erasure coding configuration, or using anything that needs random access within a file (parquet), or any day 2 operation.
on what?
Look under the hood, the limitations are based on the core, sticking a UI on it does not hide what needs to happen at scale.
Re: Databricks acquires Neon
#143Earlier quoted context omitted.
They push Serverless so hard but there are SO MANY limitations and surprise gotchas. It's driving me absolutely insane.
And it tends to be notably more expensive! 4-5x the price for less features...
the new cost-optimized mode is very promising, though
Re: Databricks acquires Neon
#144Not too familiar with Neon other than the basics - its premise is that you use S3 as bottomless storage for Postgres and it’s otherwise the same as standard Postgres right? And this is all open source? Why are people paying? Can’t you use a cloud provider and have them host this for you?
Hosting and operating the autoscaling of the various services (compute, pageserver, safekeeper, storage broker) that it takes to make all that work is complex enough that most folks would rather not. Same as any other "managed X" service.
Re: Databricks acquires Neon
#145Data warehousing is quickly becoming a commodity through open-source. I know a company who had 2PBs+ of data in Cloudera. But instead of moving to the cloud (and Databricks), they saved 5X costs by building their own analytics platform with Iceberg, Trino and Superset. The k8s operators are enterprise quality now. On-premises S3 is good, too. You can have great hardware (servers with 128 cpus and 1 TB) and networking…
But why would you buy an operational DB from Databricks? The only thing that makes sense is Databricks flailing to maintain market cap.
In addition to the AI use cases, sometimes you wanna share the data warehouse data in oltp way for fast lookups and high concurrency. Not sure whether Neon will do that but I hope so.
One example from Snowflake is hybrid tables which adds rowstore next to columnar.
OLAP + OLTP = HTAP
Re: Databricks acquires Neon
#146Data warehousing is quickly becoming a commodity through open-source. I know a company who had 2PBs+ of data in Cloudera. But instead of moving to the cloud (and Databricks), they saved 5X costs by building their own analytics platform with Iceberg, Trino and Superset. The k8s operators are enterprise quality now. On-premises S3 is good, too. You can have great hardware (servers with 128 cpus and 1 TB) and networking…
But why would you buy an operational DB from Databricks? The only thing that makes sense is Databricks flailing to maintain market cap.
ETL to bring all your data into Databricks/Snowflake is a lot of effort. Much better if your OLTP data already exists in Databricks and you directly access it from your OLAP layer.
Re: Databricks acquires Neon
#147[deleted]
Re: Databricks acquires Neon
#148Maybe unrelated but Databricks is the most annoying garbage I have ever had to use. It fascinates me how anyone uses it by choice.
They push Serverless so hard but there are SO MANY limitations and surprise gotchas. It's driving me absolutely insane.
Hey, what are the most painful limitations/gotchas you're hitting? I'm on this team and would like to hear about painpoints.
Re: Databricks acquires Neon
#149So... As someone who's joining databricks in a few weeks, what's with the hate in the comments?
In my experience, one factor is databricks releasing features fast but unpolished.
I like how they’re innovating, but it can be rough around the edges sometimes.
Re: Databricks acquires Neon
#150Earlier quoted context omitted.
on what?
Look under the hood, the limitations are based on the core, sticking a UI on it does not hide what needs to happen at scale.
Guessing you’re referring to minio not ceph? Have they still not figured out how to do day 2? I mainly avoid them because of their license and the way they interpret it