Live data from Hacker News

Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

github.com

31–40 of 85 posts

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#31
post #24

In case you don't read the whole README, note this in limitations: > The extension will load the spreadsheet only once while creating a virtual table. If you want to pick up recent changes, drop the table and create it again.

Thanks I was wondering about this, didn't want to trigger usage limits.

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#32
post #15

Last project I was involved with deals with Google Sheets. They were using it as their multiuser read/write database. I offered to migrate it all to a proper database for FREE during my own personal time outside of work. Blank stares were all I got. I really hope AGI will soon be able to replace those humans that cannot be reasoned with logic. Millions were involved, hundreds of employees, thousands of sales, all bei…

So it probably would have been better to give them an excel-like frontend connected to an sql server?

If you could match the same price, security, availability, mobile app/responsive UI support, audit history, comments, read-only sharing, export features, 3rd party add-ons, etc.

The "we will destroy all your accounts across our entire service catalog including any potential of future earnings if you cross our AI abuse detection thresholds" sword of Damocles is obviously unavailable and thus out of scope.

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#33
Spreadsheets are rather peculiar. I don't think anyone would come up with the concept of them today.

This "fill formula down/right" feature is so strange. A developer would be like: let's just set a formula for the entire column, and make it refer to another column. And let's name the columns something. Like Airtable.

But its surpringly flexible and hackable.

I wish there was something like GSheets + Airtable.

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#34
post #27

You can just use curl to get the csv from the gayest and pipe into SQLite using the .import command. Not sure what this has on top of that.

For one, there's no CSV standard and often csv based data exchange methods have lurking (and/or obvious) correctness problems. Maybe gsheets and sqlite are lucky there, maybe not. This project is also well documented including the gsheets side (which is quite non-obvious).

> For one, there's no CSV standard

This is false: https://www.rfc-editor.org/rfc/rfc4180

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#35
post #33

Spreadsheets are rather peculiar. I don't think anyone would come up with the concept of them today. This "fill formula down/right" feature is so strange. A developer would be like: let's just set a formula for the entire column, and make it refer to another column. And let's name the columns something. Like Airtable. But its surpringly flexible and hackable. I wish there was something like GSheets + Airtable.

> I wish there was something like GSheets + Airtable

Smartsheet.com ?

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#36
post #34
post #27

Earlier quoted context omitted.

For one, there's no CSV standard and often csv based data exchange methods have lurking (and/or obvious) correctness problems. Maybe gsheets and sqlite are lucky there, maybe not. This project is also well documented including the gsheets side (which is quite non-obvious).

> For one, there's no CSV standard This is false: https://www.rfc-editor.org/rfc/rfc4180

Well yes, there are actually many many CSV standards, my mistake for imprecise language. What I meant to say that there's no single CSV format that programs agree on. Starting with Excel...

Apparently it's quite common in Gsheet land to base your CSV export around things like this copypasta javascript code and customize as needed (follow forks, in parent direction too, for more of the story) https://gist.github.com/mrkrndvs/a2c8ff518b16e9188338cb809e0...

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#37
post #33

Spreadsheets are rather peculiar. I don't think anyone would come up with the concept of them today. This "fill formula down/right" feature is so strange. A developer would be like: let's just set a formula for the entire column, and make it refer to another column. And let's name the columns something. Like Airtable. But its surpringly flexible and hackable. I wish there was something like GSheets + Airtable.

> let's just set a formula for the entire column, and make it refer to another column

Meet Lotus Improv (1991): https://en.wikipedia.org/wiki/Lotus_Improv

I think the patents have expired now.

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#38
In a similar vein, Steampipe [1] has a Google Sheets plugin [2]. It uses Postgres Foreign Data Wrappers instead of SQLite as the virtual table engine. (Disclaimer: I'm a lead on this open source project.)

1 - https://github.com/turbot/steampipe 2 - https://github.com/turbot/steampipe-plugin-googlesheets

Re: Libgsqlite: A SQLite extension which loads a Google Sheet as a virtual table

#40
post #33

Spreadsheets are rather peculiar. I don't think anyone would come up with the concept of them today. This "fill formula down/right" feature is so strange. A developer would be like: let's just set a formula for the entire column, and make it refer to another column. And let's name the columns something. Like Airtable. But its surpringly flexible and hackable. I wish there was something like GSheets + Airtable.

If when you say GSheets + Airtable, you're looking for a spreadsheet that is designed for data analysis +a let's you name columns and sets formulas to the entire column, then checkout Mito (https://www.trymito.io). Disclosure: I created Mito.

Mito doesn't have real time collaboration though. That is, not until Jupyter real time collaboration becomes more popular (https://jupyterlab.readthedocs.io/en/stable/user/rtc.html)

Post reply on HN