Live data from Hacker News

Analyzing database trends through 1.8M Hacker News headlines

camelai.com

81–90 of 97 posts

Re: Analyzing database trends through 1.8M Hacker News headlines

#81
I really wanted to see the chat with HN data option or something https://camelai.com/hackernews/

But I am stuck at the cloudflare cf turnstile challenge and when I do click on it and it works, it shows error occured try again.

So frustating since I was so curious.

Re: Analyzing database trends through 1.8M Hacker News headlines

#82

There's an online playground with the data here: https://play.clickhouse.com/ Wrote up this query: SELECT db_name, sum(if(type = 'comment', 1, 0)) AS comment_mentions, sum(if(type = 'story', 1, 0)) AS post_mentions, count(*) AS total_mentions, sum(score) as total_score FROM hackernews ARRAY JOIN extractAll(replaceAll(LOWER(text), ' ', ''), '(sqlite|postgres|mysql|mongodb|redis|clickhouse|mariadb|oracle|sqlserver|duck…

Very interesting, where does the play.clickhouse get its hackernews data from though? There isn't any url link from where it fetches.

Does play.clickhouse contain all the HN data so that we can play with it?

Re: Analyzing database trends through 1.8M Hacker News headlines

#83
I almost knew that postgresql would be the winner just because of how much people recommend it here or literally anywhere. Postgres is cool.

My personal favourite depending on situations are postgres (technically supabase is postgres too),sqlite,duckdb,(valkey?)

I am just curious but guys what are your favourite options and why?

Re: Analyzing database trends through 1.8M Hacker News headlines

#84

Earlier quoted context omitted.

I do think it's an SFBA / generational bubble. We have plenty of boring, expensive software projects that someone will always bring up in a HN thread. For example, every time there's a thread on PCB design, you have some folks talking about Cadence. What's there to say about Cadence? Well, first and foremost, it costs a lot. Otherwise, it lets you design PCBs. But there are people here who pay for it, use it, and wan…

Right but having access to a Cadence license is considered "elite" (it means you are a Real Engineer), while having to use mssql server means you're kind of a schlub (who probably has to work for a real business, that makes money but is super boring, with no equity, among people who don't understand any of this status hierarchy at all).

I work with charities and non-profits, they tend to use Microsoft stack and things like Salesforce due to the large charity discounts and readily available support. I get to work with nice people doing meaningful things.

Re: Analyzing database trends through 1.8M Hacker News headlines

#86

Earlier quoted context omitted.

Oracle isn't in there either, which goes to show how much of a bubble HN actually is considering MSSQL and Oracle are #1 and #2 in market share.

I used MS SQL and Oracle at my last job, but what's there to say about them? They've been around forever, are stable and get all the same table-stakes feature updates as everyone else. Start-ups avoid them like the plague because they're so damn expensive, you won't be running either on your phone or an embedded device like SQLite either.

>Start-ups avoid them like the plague because they're so damn expensive

While in a way it's just a corollary on the expensive bit, the license compliance of the same becomes such a monumental hassle as well, and is just an enormous time waste for everyone involved. For everything you want to do there's a probing Microsoft or Oracle salesperson trying to shake you down a little harder.

Go with Postgres et al and you can be geographically distributing, horizontally and vertically scaling in a million ways, making whatever warm of cold standby or recovery system you want, and so on. Even when the pricing of the enterprise offerings were tolerable, the system around constantly extracting a pound of flesh is so overbearing it induces opposition.

Re: Analyzing database trends through 1.8M Hacker News headlines

#87

There's an online playground with the data here: https://play.clickhouse.com/ Wrote up this query: SELECT db_name, sum(if(type = 'comment', 1, 0)) AS comment_mentions, sum(if(type = 'story', 1, 0)) AS post_mentions, count(*) AS total_mentions, sum(score) as total_score FROM hackernews ARRAY JOIN extractAll(replaceAll(LOWER(text), ' ', ''), '(sqlite|postgres|mysql|mongodb|redis|clickhouse|mariadb|oracle|sqlserver|duck…

Very interesting, where does the play.clickhouse get its hackernews data from though? There isn't any url link from where it fetches. Does play.clickhouse contain all the HN data so that we can play with it?

relevant GH issue I think

https://github.com/ClickHouse/ClickHouse/issues/29693

Re: Analyzing database trends through 1.8M Hacker News headlines

#88
post #71

Earlier quoted context omitted.

They are perhaps #1 and #2 in the "enterprise" market share, but in no way are they overall #1 and #2. Not even close. Which web app or startup uses them?

Which web app or startup uses them? Well with that question you neatly define the bubble that you inhabit. https://db-engines.com/en/ranking ranks Oracle at number 1 and MS Sql Server at number 3, their method being a broad range of statistics based on job offers and web search statistics.

Yes, this is HACKER News

Re: Analyzing database trends through 1.8M Hacker News headlines

#89
post #75

Earlier quoted context omitted.

Oracle isn't in there either, which goes to show how much of a bubble HN actually is considering MSSQL and Oracle are #1 and #2 in market share.

Nor is DB2. A non trivial amount of HN's personal wealth is being tracked with this technology right now.

I'll admit I don't even know what DB2 is

Re: Analyzing database trends through 1.8M Hacker News headlines

#90
post #6

Earlier quoted context omitted.

I am getting an infinite loop of 'Verify you are human'....

We use cloudflare turnstile. Sometimes it blocks some VPNs. Very rarely it blocks some browsers.

Blocks me too. (Infinite loop "Verifying...") Firefox on macOS. No VPN.
Post reply on HN