Database of Databases

Writing a simple query engine can be accomplished with a trie and a hash map to be a bit like Dynamo DB and SQL is straightforward to parse (but a pain to implement).

https://github.com/samsquire/hash-db https://github.com/samsquire/sql-database

These are my very straightforward codebases where I've been experimenting with SQL parsing (and execution) and dynamo db style querying.

You need an efficient range operator to implement a database.

Re: Database of Databases

#6

Post by fegu » Wed, Sep 16, 2020, 5:17 PM UTC

chickenpotpie wrote: post #3

Reminds me of my favorite Wikipedia article: https://en.wikipedia.org/wiki/List_of_lists_of_lists

My god that is a rabbit hole. Thanks for this! (But there goes my evening..)

Re: Database of Databases

#7

Post by overcast » Wed, Sep 16, 2020, 5:22 PM UTC

Are these websites just completely unable to handle a 1000 simultaneous requests?

Re: Database of Databases

#8

Post by etxm » Wed, Sep 16, 2020, 5:25 PM UTC

overcast wrote: post #7

Are these websites just completely unable to handle a 1000 simultaneous requests?

They should have used a JSON file as the backend.

Re: Database of Databases

#9

Post by samsquire » Wed, Sep 16, 2020, 5:26 PM UTC

They're using SQLite which is single threaded and single user by design. So this website will not be able to service that much traffic.

Re: Database of Databases

#10

Post by tyingq » Wed, Sep 16, 2020, 5:31 PM UTC

samsquire wrote: post #9

They're using SQLite which is single threaded and single user by design. So this website will not be able to service that much traffic.

Should be fine for reads. Sqlite.org is dynamic, pulling from sqlite data for ~20% of the pages, and it does fine with HN piling on. The single threaded would be an issue for writes, but I don't see why they would be doing writes for a page view. See https://www.sqlite.org/whentouse.html