Live data from Hacker News

What If OpenDocument Used SQLite?

sqlite.org

11–20 of 109 posts

Re: What If OpenDocument Used SQLite?

#11

What if instead of API's for data sets, we simply placed a sqlite file onto a web server as a static asset, so you could just periodically do a GET and have a local copy.

With an S3 object lambda, I suppose you could generate the sqlite file on the fly.

Re: What If OpenDocument Used SQLite?

#12

What if instead of API's for data sets, we simply placed a sqlite file onto a web server as a static asset, so you could just periodically do a GET and have a local copy.

A few years ago someone posted a site that showed how to query portions of a SQLite file without having to pull the whole thing down.

Re: What If OpenDocument Used SQLite?

#13

wouldn’t an XML database be easier?

You can't* index into XML. You have to read through the whole document until you get to the part you want.

*: without adding an index of your own, at which point it isn't really XML anymore, it's some kind of homebrew XML-based archive format.

Re: What If OpenDocument Used SQLite?

#16
If I remember correctly Mendix project file format is simply a sqlite db. I thought the designer was lazy but it turns out it's a reasonable decision.

Recently, DuckDB team raise similar question on DataLake catalog format. Why not just use SQL database for that ? It's simpler and more efficient as well.

Re: What If OpenDocument Used SQLite?

#17

What if instead of API's for data sets, we simply placed a sqlite file onto a web server as a static asset, so you could just periodically do a GET and have a local copy.

You can do this today by using the WASM-compiled SQLite module with a custom Javascript VFS that implements the SQLite VFS api appropriately for your backend. I've used it extensively in the past to serve static data sets direct from S3 for low cost.

More industrious people have apparently wrapped this up on NPM: https://www.npmjs.com/package/sqlite-wasm-http

Re: What If OpenDocument Used SQLite?

#18
It seems like it would be relatively straightforward to make an sqlite based file format and just have users add a plugin if for some reason they couldn't upgrade their older version of LibreOffice etc. I agree with the other commenter who mentioned that the benefits for text and spreadsheet files needs more explanation. But it seems like a good enough idea to have a LibreOffice working group perform a more in depth study. If significant memory reduction is real and that would translate to fewer crashes, it would be a huge boost even if it had no other benefits, IMHO.

Re: What If OpenDocument Used SQLite?

#19
post #12

What if instead of API's for data sets, we simply placed a sqlite file onto a web server as a static asset, so you could just periodically do a GET and have a local copy.

A few years ago someone posted a site that showed how to query portions of a SQLite file without having to pull the whole thing down.

https://news.ycombinator.com/item?id=27016630
Post reply on HN