Live data from Hacker News

How I store server logs in Google Spreadsheets

hakanu.net

1–10 of 16 posts

Re: How I store server logs in Google Spreadsheets

#2
I'm pretty disappointed with google sheet at the moment. I built some mildly complex spreadsheets for time tracking, nutrition, planning and such. They worked fine a year ago but I have experienced a massive drop in performance over the past few months. They take a minute to open and awfully slow to update calculations and no longer work reliably offline either. This is on an quad core desktop ffs.

This will kill cloud office apps if what works today doesn't work tomorrow. Cloud should not mean total loss of control of the version of the application. Something like gdocs should be offering frozen past versions of the app to avoid this type of thing being possible. Its not like frozen versions would actually add any maintenance cost to google.

These sheets are small and just have a few array forumulae. Nothing excel 20 years would have broken a sweat over.

Re: How I store server logs in Google Spreadsheets

#4

I'm pretty disappointed with google sheet at the moment. I built some mildly complex spreadsheets for time tracking, nutrition, planning and such. They worked fine a year ago but I have experienced a massive drop in performance over the past few months. They take a minute to open and awfully slow to update calculations and no longer work reliably offline either. This is on an quad core desktop ffs. This will kill clo…

Have you upgraded to the newest version of google spreadsheets? We were having some performance issues that sound just like what you're experiencing and as soon as we made the switch, our sheets were super fast.

Re: How I store server logs in Google Spreadsheets

#6
post #4

I'm pretty disappointed with google sheet at the moment. I built some mildly complex spreadsheets for time tracking, nutrition, planning and such. They worked fine a year ago but I have experienced a massive drop in performance over the past few months. They take a minute to open and awfully slow to update calculations and no longer work reliably offline either. This is on an quad core desktop ffs. This will kill clo…

Have you upgraded to the newest version of google spreadsheets? We were having some performance issues that sound just like what you're experiencing and as soon as we made the switch, our sheets were super fast.

I upgraded a couple when it was first released but a few basic features not supported so had to abandon the attempt.

I've tried copying a problem sheet to a new file and first impressions are positive. Thanks.

Re: How I store server logs in Google Spreadsheets

#7
We kinda whipped up something for our own purposes (logging any data using google spreadsheets). It's called Sheetstorm and basically you just post data using the API and it'll automatically create a new sheet or append it to an existing one.

It's handy for logging and analyzing arbitrary stats.

https://www.sheetstorm.io/

Re: How I store server logs in Google Spreadsheets

#8
To address the speed problem you could still leverage sqlite locally as cache layer in between your in-memory cache and longer-term google spreadsheet cache, and use a repeating job to move the sqlite data over to google spreadsheets (and subsequently delete those rows in the sqlite, keeping the sqlite db at a small size).

Re: How I store server logs in Google Spreadsheets

#9
post #4

Earlier quoted context omitted.

Have you upgraded to the newest version of google spreadsheets? We were having some performance issues that sound just like what you're experiencing and as soon as we made the switch, our sheets were super fast.

I upgraded a couple when it was first released but a few basic features not supported so had to abandon the attempt. I've tried copying a problem sheet to a new file and first impressions are positive. Thanks.

As far as I observed, latest big update improved the performance of large sheets a lot. Plus, using chrome is also making some positive difference. However, copying and pasting large data is still a problem. Instead I recommend to use copy to option within google drive.

Re: How I store server logs in Google Spreadsheets

#10
post #8

To address the speed problem you could still leverage sqlite locally as cache layer in between your in-memory cache and longer-term google spreadsheet cache, and use a repeating job to move the sqlite data over to google spreadsheets (and subsequently delete those rows in the sqlite, keeping the sqlite db at a small size).

that's a good idea actually. It will be safer for retries thanks! For future reference, increasing the number of rows persisted makes the time complexity also increase.
Post reply on HN