Show HN: Query Google Sheet data using PostgreSQL clients
roapi.github.io
Show HN: Query Google Sheet data using PostgreSQL clients
1–10 of 24 posts
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#2I spent years using Excel but I mostly use Google Sheets now. The cloud integration just feels much more effortless compared to Microsoft’s Office products ported to cloud. I’ve seen departments using GS as a system of record for quickly setting up master data like budgets and forecasts. I wish it had database connectivity the way Excel has ODBC.
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#3Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly.
Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#4Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly. Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#5Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly. Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
No post body was provided.
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#6Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly. Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
How does cache invalidation work?
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#7Earlier quoted context omitted.
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
How does cache invalidation work?
It's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh.
I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#8This is cool; from reading the descriptions I presume this doesn't support writing - is there any intention to do so?
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#9This is cool; from reading the descriptions I presume this doesn't support writing - is there any intention to do so?
Nevermind, I just worked out how to get to the overview. ROAPI seems to stand for read-only API :)
Re: Show HN: Query Google Sheet data using PostgreSQL clients
#10I have thought about using google sheets as the database for projects many times.
The great thing about it is that you get a very versatile admin UI for free. The downsides however are rate limits and the fact that I can't think of any way to build in some sort of safety that would prevent people from accidentally deleting a bunch of data with a mouse click. I would love to hear if anyone has real life experience with the approach.