Analyzing database trends through 1.8M Hacker News headlines • Hacker News Board

Re: Analyzing database trends through 1.8M Hacker News headlines

#31

Post by vercantez » Thu, Jul 10, 2025, 5:28 PM UTC

Tepix wrote: post #8

Sqlite seems to be growing recently which matches my perception, but it‘s not listed among the growing databases. Weird.

SQLite is now reflected in the growth table

Re: Analyzing database trends through 1.8M Hacker News headlines

#32

Post by vercantez » Thu, Jul 10, 2025, 5:29 PM UTC

RS-232 wrote: post #10

No SQLite?

Fixed.

Re: Analyzing database trends through 1.8M Hacker News headlines

#33

Post by jabart » Thu, Jul 10, 2025, 5:33 PM UTC

123yawaworht456 wrote: post #12

>a ClickHouse database of every HN story I remember downloading it a few years ago, but the bookmark I have is dead. where is it now? is it still public?

Still Public, still chews through million->billion or rows in seconds. Their Cloud version has some Cloud specific features. A few vendors have build custom thing on top or custom builds off the open source project too.

Re: Analyzing database trends through 1.8M Hacker News headlines

#34

Post by gushie » Thu, Jul 10, 2025, 5:51 PM UTC

bellareed wrote: post #26

xnx wrote: post #25

Confusingly, I just came across the unrelated https://www.camel-ai.org/ today.

Sooo confusing. We've debated changing our name but can't bring ourselves to break up with our cute camel logo lol.

I would have suggested HumpAI if hump didn't have another meaning that might attract users you didn’t intend :)

Re: Analyzing database trends through 1.8M Hacker News headlines

#35

Post by 98codes » Thu, Jul 10, 2025, 5:52 PM UTC

Interesting to see SQL Server not listed here, am curious whether it didn't have enough signal, or suffered from being a two-word product, with "SQL" being far too generic on its own.

Re: Analyzing database trends through 1.8M Hacker News headlines

#36

Post by xnx » Thu, Jul 10, 2025, 5:53 PM UTC

More unsolicited feedback: Month-by-month is kind of noisy. You might do 3 month average to smooth it a little and make the trend clearer.

Re: Analyzing database trends through 1.8M Hacker News headlines

#37

Post by vercantez » Thu, Jul 10, 2025, 5:58 PM UTC

UPDATE: Added a weighted average analysis based on story points and comments. SQLite ranks highest in points per story and Redis ranks highest in comments per post. Also added SQLite to the growth table. I had accidentally deleted this row in the original post.

Re: Analyzing database trends through 1.8M Hacker News headlines

#38

Post by vercantez » Thu, Jul 10, 2025, 5:59 PM UTC

xnx wrote: post #22

Would be great to share the queries. Are these results weighted for storypoints and/or number of comments?

Updated with weighted analysis.

Re: Analyzing database trends through 1.8M Hacker News headlines

#39

Post by conradkay » Thu, Jul 10, 2025, 6:01 PM UTC

There's an online playground with the data here: https://play.clickhouse.com/

Wrote up this query:

  SELECT
    db_name,
    sum(if(type = 'comment', 1, 0)) AS comment_mentions,
    sum(if(type = 'story', 1, 0)) AS post_mentions,
    count(*) AS total_mentions,
    sum(score) as total_score
  FROM hackernews
  ARRAY JOIN
    extractAll(replaceAll(LOWER(text), ' ', ''), '(sqlite|postgres|mysql|mongodb|redis|clickhouse|mariadb|oracle|sqlserver|duckdb)') AS db_name
  WHERE toYear(time) >= 2022
  GROUP BY
    db_name
  ORDER BY
    post_mentions DESC;

Re: Analyzing database trends through 1.8M Hacker News headlines

#40

Post by RadiozRadioz » Thu, Jul 10, 2025, 6:06 PM UTC

98codes wrote: post #35

Interesting to see SQL Server not listed here, am curious whether it didn't have enough signal, or suffered from being a two-word product, with "SQL" being far too generic on its own.

It is also less mentioned on the site in general, owing to it being a proprietary Microsoft product in an audience of people who primarily go for Free / Open Source non-Microsoft products.

There are some people here who are interested in corporate Europe or , but most are aligned with Silicon Valley hackers.