Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Databricks acquires Neon

databricks.com

Post reply on HN
Print view View original

101–110 of 234 posts

Re: Databricks acquires Neon

#101

Post by tudorg »

chime wrote: post #98
tudorg wrote: post #10

Earlier quoted context omitted.

[Disclaimer: I work for Xata] As it happens, we've just launched our new Xata platform ( https://xata.io/ ) which has some of the key Neon features: instant copy-on-write branching and separation of storage and compute. As an extra twist, we also can do anonymization (PII masking) between your production database and developer branches. The way we do copy-on-write branches is a bit different. We haven't done any modi…

1. Would you sign BAA (for HIPAA) for the Pay As You Go plan? Can't find that anywhere on your site except for that Lite is HIPAA compliant ( https://lite.xata.io/security ). 2. FYI, couldn't request access via the BYOC form so I sent an email as per the error: There was an error, please try again or contact us at info@xata.io.

1. Yes, we will sign BAA for Pay As You Go.

2. Thanks, I see you sent the email already, not sure why it failed. Will reach out over email.

Re: Databricks acquires Neon

#102

Post by isignal »

mritchie712 wrote: post #19
flanked-evergl wrote: post #3

Maybe unrelated but Databricks is the most annoying garbage I have ever had to use. It fascinates me how anyone uses it by choice.

Databricks started in 2013 when Spark sucked (it still does) and they aimed to make it better / faster (which they do). The product is still centered Spark, but most companies don't want or need Spark and a combination of Iceberg and DuckDB will work for 95% of companies. It's cheaper, just as fast or faster and way easier to reason about. We're building a data platform around that premise at Definite[0]. It includes…

Aren't the alternatives you mentioned - icerberg and duckdb - both storage solutions while spark is a way to express distributed compute? I'm a bit out of touch with this space, is there a newer way to express distributed compute?

Re: Databricks acquires Neon

#103

Post by refset »

amazingamazing wrote: post #81

Not too familiar with Neon other than the basics - its premise is that you use S3 as bottomless storage for Postgres and it’s otherwise the same as standard Postgres right? And this is all open source? Why are people paying? Can’t you use a cloud provider and have them host this for you?

> you use S3 as bottomless storage for Postgres [...] Why are people paying?

It's vastly more complicated to do this efficiently than you might imagine. Postgres' internal architecture is built around a very different set of assumptions (pages, WAL, local disk etc.) than what the S3 API offers.

Re: Databricks acquires Neon

#104

Post by anshumankmr »

joshstrange wrote: post #85
anshumankmr wrote: post #84

Earlier quoted context omitted.

Any alternatives that you are aware of ? Most search results show me Supabase.

Supabase is one that I'll consider, Xata [0] is another one that is interesting. Thankfully I just need "postgres", I don't need branching/PII-clearing/etc. That's all nice to have but I don't need it for my app. I really would prefer a managed DB for multiple reasons but I might need to look at just self-hosting. I might have spent less time futzing with my DB if I had done that from the start instead of going Auror…

Same here...I too just need Postgres... Will check out Xata, My workload isn't super critical.

Re: Databricks acquires Neon

#105

Post by Nate75Sanders »

isignal wrote: post #102
mritchie712 wrote: post #19

Earlier quoted context omitted.

Databricks started in 2013 when Spark sucked (it still does) and they aimed to make it better / faster (which they do). The product is still centered Spark, but most companies don't want or need Spark and a combination of Iceberg and DuckDB will work for 95% of companies. It's cheaper, just as fast or faster and way easier to reason about. We're building a data platform around that premise at Definite[0]. It includes…

Aren't the alternatives you mentioned - icerberg and duckdb - both storage solutions while spark is a way to express distributed compute? I'm a bit out of touch with this space, is there a newer way to express distributed compute?

Flink. It has more momentum than Spark right now.

Re: Databricks acquires Neon

#106

Post by matt-p »

lars_francke wrote: post #93
jamesblonde wrote: post #74

Data warehousing is quickly becoming a commodity through open-source. I know a company who had 2PBs+ of data in Cloudera. But instead of moving to the cloud (and Databricks), they saved 5X costs by building their own analytics platform with Iceberg, Trino and Superset. The k8s operators are enterprise quality now. On-premises S3 is good, too. You can have great hardware (servers with 128 cpus and 1 TB) and networking…

Anyone looking for an open-source Cloudera alternative based on Kubernetes operators. We're building one (~5 years old now): https://stackable.tech/ & https://github.com/stackabletech/ On-premise open-source S3 is a problem though. MinIO is not something we're touching and other than that it looks a bit empty with enterprise ready solutions.

What's wrong with minio out of curiosity? Ceph an option?

Re: Databricks acquires Neon

#107

Post by everfrustrated »

From the actual article

>As Neon became GA last year, they noticed an interesting stat: 30% of the databases were created by AI agents, not humans. When they looked at their stats again recently, the number went from 30% to over 80%. That is, AI agents were creating 4 times more databases versus humans.

For me this has alarm bells all over it. Databricks is trying to pump postgres as some sort of AI solution. We do live in weird times.

Re: Databricks acquires Neon

#108

Post by kwillets »

jamesblonde wrote: post #74

Data warehousing is quickly becoming a commodity through open-source. I know a company who had 2PBs+ of data in Cloudera. But instead of moving to the cloud (and Databricks), they saved 5X costs by building their own analytics platform with Iceberg, Trino and Superset. The k8s operators are enterprise quality now. On-premises S3 is good, too. You can have great hardware (servers with 128 cpus and 1 TB) and networking…

It's been a commodity for decades now. Metrics like price-performance have a long history, but the SnowBricks products fail at them quite dramatically. The difference is hard-sell vs. soft or no-sell.

Re: Databricks acquires Neon

#109

Post by tudorg »

Squarex wrote: post #70
tudorg wrote: post #10

Earlier quoted context omitted.

[Disclaimer: I work for Xata] As it happens, we've just launched our new Xata platform ( https://xata.io/ ) which has some of the key Neon features: instant copy-on-write branching and separation of storage and compute. As an extra twist, we also can do anonymization (PII masking) between your production database and developer branches. The way we do copy-on-write branches is a bit different. We haven't done any modi…

Do you support http or websocket connections like https://github.com/neondatabase/serverless ? In my experience neon is ultra fast that way in serverless environments like 1-5ms per query with network roundtrip.

We have support for SQL over HTTP in Xata Lite: https://lite.xata.io/docs/sdk/sql/overview

Re: Databricks acquires Neon

#110

Post by pradn »

foota wrote: post #56

So... As someone who's joining databricks in a few weeks, what's with the hate in the comments?

Every company gets a ton of hate on Hacker News. Don't let it bother you too much. But the specific concerns may be a directional signal.
Post reply on HN