It certainly will be in the toolkits of data archeologists hundreds of years from now. Must be a weird feeling to create something so potentially long-lasting.
SQLite Is a Library of Congress Recommended Storage Format
101–110 of 205 posts
Re: SQLite Is a Library of Congress Recommended Storage Format
#102I have always loved SQLite. I have also heard that some firms ban its use. Why? Because it makes it SO easy to set up a database for your app that you end up with a super critical component of your application that looks exactly like a file. A file that can have any extension. And that file can be copied around to other servers. Even if there is PII in that file. Multiply this times the number of applications in your…
I recently watched a YT video about this subject: https://www.youtube.com/watch?v=lSVgeMoXJTs
In summary, companies use the bus-metric to see how viable a project is. Bus, as in, how many people can be hit by a bus before there is no one left to maintain the project.
Despite its ubiquity, SQLite is maintained by only 3 people. That bus-metric for SQLite is 3, which is way too low for some companies.
Give the link a watch; it was really interesting.
Re: SQLite Is a Library of Congress Recommended Storage Format
#103I'm always inspired by SQLite. Overall I like it, but if you're not doing writes it's really overkill. So I made a format that will never surpass SQLite, except that it's extremely lighter and faster and works on zstd compressed files. It has really small indexes and can contain binaries or text just like SQLite. The wasm part that decompresses and reads and searches the databases is only 38kb (uncompressed (maybe 16…
SQLite is simple in its own way and I like the design principle of their SQL dialect. "Right joins are just left joins in the wrong direction, you don't need that crap" Of course it always gets simpler or more specialised. I think many apps using databases would run with SQLite just as well. And some would probably run just as well with a textfile instead of any db like SQLite.
For the love of god, don't do blank textiles anymore. In the end you have a software that has 20 (or more) individual files for each programs section, which works fine until you want the files to be consistent. Boom. And then you add a lock to fix it and suddenly your whole program can only run sequentially. And then your customers ask why it's so slow in ingress. I won't name any names here, but this is a real commercial product.
Re: SQLite Is a Library of Congress Recommended Storage Format
#104I used SQLite for a few applications several years ago. One time, the database got corrupted and all the data was lost. That was the day I stopped using SQLite. Also, the lack of enforced column data types was always a negative for me.
No matter the medium, backups are a must.
A hard lesson learned...
Re: SQLite Is a Library of Congress Recommended Storage Format
#105I used SQLite for a few applications several years ago. One time, the database got corrupted and all the data was lost. That was the day I stopped using SQLite. Also, the lack of enforced column data types was always a negative for me.
For column types there are STRICT tables now
Thank you!
Re: SQLite Is a Library of Congress Recommended Storage Format
#106It is great to see SQLite getting this level of institutional recognition. The single file format makes archival storage incredibly straightforward compared to traditional database dumps.
Re: SQLite Is a Library of Congress Recommended Storage Format
#107I used SQLite for a few applications several years ago. One time, the database got corrupted and all the data was lost. That was the day I stopped using SQLite. Also, the lack of enforced column data types was always a negative for me.
> the database got corrupted What caused that?
I don't know why that happened, but one fine day I tried to open the file using the vanilla SQLite client, and it didn't open.
Re: SQLite Is a Library of Congress Recommended Storage Format
#108Earlier quoted context omitted.
SQLite is simple in its own way and I like the design principle of their SQL dialect. "Right joins are just left joins in the wrong direction, you don't need that crap" Of course it always gets simpler or more specialised. I think many apps using databases would run with SQLite just as well. And some would probably run just as well with a textfile instead of any db like SQLite.
For the love of god, don't do blank textiles anymore. In the end you have a software that has 20 (or more) individual files for each programs section, which works fine until you want the files to be consistent. Boom. And then you add a lock to fix it and suddenly your whole program can only run sequentially. And then your customers ask why it's so slow in ingress. I won't name any names here, but this is a real comme…
We use a cheap invoicing program. It works fine except it gets very slow when dealing with large numbers if invoices. Turns out each invoice (or payment record, or customer record, or whatever) is a separate text file with form-urlencoded data. No indices.
Re: SQLite Is a Library of Congress Recommended Storage Format
#109I have always loved SQLite. I have also heard that some firms ban its use. Why? Because it makes it SO easy to set up a database for your app that you end up with a super critical component of your application that looks exactly like a file. A file that can have any extension. And that file can be copied around to other servers. Even if there is PII in that file. Multiply this times the number of applications in your…
I recently watched a YT video about this subject: https://www.youtube.com/watch?v=lSVgeMoXJTs In summary, companies use the bus-metric to see how viable a project is. Bus, as in, how many people can be hit by a bus before there is no one left to maintain the project. Despite its ubiquity, SQLite is maintained by only 3 people. That bus-metric for SQLite is 3, which is way too low for some companies. Give the link a w…
At least with SQLite, it is really stable so if development did cease, you'd probably be fine indefinitely.
Re: SQLite Is a Library of Congress Recommended Storage Format
#110I'm always inspired by SQLite. Overall I like it, but if you're not doing writes it's really overkill. So I made a format that will never surpass SQLite, except that it's extremely lighter and faster and works on zstd compressed files. It has really small indexes and can contain binaries or text just like SQLite. The wasm part that decompresses and reads and searches the databases is only 38kb (uncompressed (maybe 16…
It is crashing Safari.
Works on my wife's old iphone. I don't have a mac to test things on.