Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

SQLite Is Serverless

sqlite.org

Post reply on HN
Print view View original

301–310 of 453 posts

Re: SQLite Is Serverless

#301

Post by idclip »

filleduchaos wrote: post #178
idclip wrote: post #85

Earlier quoted context omitted.

That just circle jerk. There is an agreed upon def of serverless. If we reduce things to the absurd we stop being able to reason about things. https://en.m.wikipedia.org/wiki/Serverless_computing

That is not the definition of serverless in question.

If you examine it closely, youll see that they have alot incommon, and that the author defined the term neo-serverless to attempt to adress this - both definitions share the fact that multiple applications (in clientless form) can access the database. He even gives amazon S3 as an example. For neo serverless.

I agree with you that it take a bit to marry both, but the stretch isnt far.

Im also avoiding criticising the Author for not sticking to the main def, since id then be red-herringing the post.

Re: SQLite Is Serverless

#302

Post by dacort »

pm90 wrote: post #166

What I really want: SQLite storage backend driver for s3/gcs. No need for disks then. I haven’t been able to find such a solution though; and am not technically proficient enough in C (the Lang SQLite is written in) to do so myself.

As part of a fun side project to make a SQLite driver for Athena, I made a read-only storage driver for S3.

https://github.com/dacort/athena-sqlite/blob/master/lambda-f...

Implemented the VFS side in Python, thanks to the awesome apsw library.

Re: SQLite Is Serverless

#303

Post by manigandham »

XelNika wrote: post #154
manigandham wrote: post #47

Earlier quoted context omitted.

SQLite is meaningless to non-IT people.

Non-IT people make IT decisions all the time. If you can sell your IT product to C-levels, they'll force IT to use it. Look at how companies misuse things like blockchain, ML and AI just because of the hype around those words.

Yea, that's now how SQLite has ever been sold. All the other comments on this post have since shown just how useless the "serverless" label is for this.

Re: SQLite Is Serverless

#304

Post by manigandham »

tastroder wrote: post #72
manigandham wrote: post #47

Earlier quoted context omitted.

SQLite is meaningless to non-IT people.

Those people wouldn't end up on a random documentation page for SQLite then, making this argument superfluous. > I would love to know who uses "serverless" instead of "in-process". Why add a new term at all? This discounts which term came first. Back in 2007 it was just fine to talk about this as being serverless, the marketing term gained popularity years later. They even talk about the more recent definition on the…

I didn't make the argument, the other poster did.

It doesn't matter what definition came first. It was bad back then when embedded and in-process already existed. Now it's even worse.

Re: SQLite Is Serverless

#305

Post by travbrack »

bane wrote: post #201
travbrack wrote: post #193

Earlier quoted context omitted.

I've seen several software projects that are built for rdbms let you use sqlite. It works.

They're using SQLite as the file format for persisting data. It's a great file format for this. You can even build an RDBMS over top of uncompressed WAV files if you want. It doesn't make WAV files RDBMs.

But SQLite has rdbms features. I remember being able to show tables and do SQL queries in SQLite DBs.

Re: SQLite Is Serverless

#306

Post by dacort »

SQLite is amazingly prevalent as well. Your own phone probably has hundreds of SQLite databases on it. One challenge with SQLite, though, is you have to download the whole thing to make use of it.

Shameless plug, but I made a fun side project that allows Amazon Athena to read SQLite databases from S3. https://github.com/dacort/athena-sqlite

Re: SQLite Is Serverless

#307

Post by erezsh »

siscia wrote: post #282
erezsh wrote: post #257

Earlier quoted context omitted.

Looks pretty cool! I can imagine it would be useful for data-science projects, if the pricing is right.

What pricing would feel right to you?

I'm far from an expert on such things, but I like the adjustable fixed-price model (like digital ocean).

Whenever I see a price like 0.0002$ per hour, I feel like they're trying to mess with my intuition.

That's especially applicable to data-science, because you're not worried so much about automatic scaling, you just don't want to be surprised at the end of the month.

I don't know if you can match digital ocean's prices (they offer managed postgres, for a fair comparison), but if you can get close then you have a chance.

Re: SQLite Is Serverless

#308

Post by palotasb »

sly010 wrote: post #300
nicholaides wrote: post #185

I think a good under-appreciated use case for SQLite is as a build artifact of ETL processes/build processes/data pipelines. Seems like lot of people's default, understandably, is to use JSON as the output and intermediate results, but if you use SQLite, you'd have all the benefits of SQL (indexes, joins, grouping, ordering, querying logic, and random access) and many of the benefits of JSON files (SQLite DBs are jus…

I have been using SQLite as a format to move data between steps in a complicated batch processing pipeline. With the right pragmas it is both faster and more compact than JSON. It is also much more "human readable" than gigabytes of JSON. I only wish there was a way to open an http-fetched SQLite database from memory so I don't have to write it to disk first.

You can use the memvfs module to load in-memory databases if you're using the C API. I'm not sure how many higher-level APIs support it though.

[1] https://stackoverflow.com/a/53453338/3063 [2] https://www.sqlite.org/loadext.html#example_extensions [3] https://www.sqlite.org/src/file/ext/misc/memvfs.c

Re: SQLite Is Serverless

#309

Post by siscia »

erezsh wrote: post #307
siscia wrote: post #282

Earlier quoted context omitted.

What pricing would feel right to you?

I'm far from an expert on such things, but I like the adjustable fixed-price model (like digital ocean). Whenever I see a price like 0.0002$ per hour, I feel like they're trying to mess with my intuition. That's especially applicable to data-science, because you're not worried so much about automatic scaling, you just don't want to be surprised at the end of the month. I don't know if you can match digital ocean's pr…

I was thinking something based on size or performance.

1 req for second, free.

50 req for second, 5€.

Unmetered, 30€.

Maybe not counting for seconds but for hour or day so to accommodate burst.

Another option would be on features. But that will requires time.

Re: SQLite Is Serverless

#310

Post by manigandham »

m3kw9 wrote: post #130

I don’t get it, then any db can be classic serverless if they run in the same computer as the app?

Yes, technically, although they make the distinction is that it's in the same process.

It's a bad definition. I would stick with the terms "embedded" or "in-process" which have been around for decades and are well-understood.

Post reply on HN