Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
1–10 of 12 posts
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#2This documentation page is an excellent overview for anyone who wishes to understand how a declarative language such as SQL is actually translated to an execution plan behind the scenes:
https://github.com/google/lovefield/blob/master/docs/dd/05_q...
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#3SQL-like? How about your use a real SQL used in SQLite, https://github.com/kripken/sql.js/
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#4Now they only need to add a "commitToServer()" feature that uses some diff since the last commit and we got a stew going.
That tech is promising though, I like that we're opening new possibilities all the time.
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#5As someone who has extensively used/abused IndexedDB in the development of http://basketball-gm.com/ I can say that I'm really happy to see some serious libraries built on top of IDB. Years ago people said "yeah, it doesn't have all the features of Web SQL, but you could build something like that on top of it" but now that's finally starting to actually happen.
Other cool IDB projects are YDN-DB https://github.com/yathit/ydn-db which continues to develop and Dexie https://github.com/dfahlander/Dexie.js/wiki/Dexie.js which is also new.
I hope that some time in the near future I can stop writing ugly hacks in raw IDB to account for missing database features and browser incompatibilities. But I worry about losing performance if I delegate too much to one of these libraries (although I haven't really started seriously testing them yet).
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#6SQL-like? How about your use a real SQL used in SQLite, https://github.com/kripken/sql.js/
Not the same use case. Lovefield is built on IndexedDB which allows you to store persistent data client-side, not just in memory or on a server.
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#7Now they only need to add a "commitToServer()" feature that uses some diff since the last commit and we got a stew going. That tech is promising though, I like that we're opening new possibilities all the time.
We did this with sqlite about six years back and got awesome performance results. It was a system called SyncKit. Still would have preferred relational storage in the browser, but glad to see at least we're moving toward something.
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#8You need to support Python, Java AND Node.js for this? Sheesh.
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#9Now they only need to add a "commitToServer()" feature that uses some diff since the last commit and we got a stew going. That tech is promising though, I like that we're opening new possibilities all the time.
The problem there, however, is you don't have distributed transactions and locks/leases. You would need to build that into the server itself, which is obviously out of scope for this project.
If the server changes, as it could easily do if you had two separate browsers open (say, mobile safari and your desktop), you'd need quite a bit conflict resolution code.
Re: Lovefield: Cross-browser, SQL-like, relational query engine on top of IndexedDB
#10https://github.com/google/lovefield/blob/master/docs/dd/04_c...
Lovefield has an in-memory row cache, which is conceptually a big map of row ids to rows (and that is why Lovefield has unique row ids across the board). Currently the cache is a "dumb" cache: it contains exact duplica of what are persisted in the IndexedDB. The reason for doing that is to workaround IndexedDB inefficiency of handing bulk I/O, as described in backstore section. By caching all rows in memory, Lovefield avoids any additional round-trip required to load data from IndexedDB, with the price of memory usage.
How does that handle the case where the user has the app open in two tabs? Is there any synchronization?