Tosheets, utility to send stdin to Google sheets • Hacker News Board

Re: Tosheets, utility to send stdin to Google sheets

#11

Post by gcr » Sat, Nov 18, 2017, 5:27 AM UTC

sillysaurus3 wrote: post #9

notaboutdave wrote: post #4

This is pretty great. It looks like it automatically writes to the next logical empty cell. curl https://www.bitstamp.net/api/v2/ticker/btcusd \ | grep 'last": *"\d*\.\d*' -o | grep '\d*\.\d*' -o \ | tosheets -c A1 --spreadsheet=foo ^ That will append the last BTC price to column A of sheet 'foo'

Can I nerd out over how unreasonably effective regexps are? That's basically a mini JSON parser in 48 characters.

With a domain-specific tool, it's even easier though.

    curl ... | jq -r .last

Re: Tosheets, utility to send stdin to Google sheets

#12

Post by sillysaurus3 » Sat, Nov 18, 2017, 5:28 AM UTC

gcr wrote: post #11

sillysaurus3 wrote: post #9

Earlier quoted context omitted.

Can I nerd out over how unreasonably effective regexps are? That's basically a mini JSON parser in 48 characters.

With a domain-specific tool, it's even easier though. curl ... | jq -r .last

Sure. But you can't use jq to scrape arbitrary websites, for example. :)

Re: Tosheets, utility to send stdin to Google sheets

#13

Post by jldugger » Sat, Nov 18, 2017, 7:11 AM UTC

sillysaurus3 wrote: post #12

gcr wrote: post #11

Earlier quoted context omitted.

With a domain-specific tool, it's even easier though. curl ... | jq -r .last

Sure. But you can't use jq to scrape arbitrary websites, for example. :)

Of course, if it's anything like HTML, the formatting will vary over time that you really want a more permissive parser like BeautifulSoup. I haven't found a cli interface, so I briefly wrote my own ages ago: https://github.com/jldugger/dotfiles/blob/master/bin/select.....

Re: Tosheets, utility to send stdin to Google sheets

#14

Post by [deleted] » Sat, Nov 18, 2017, 7:40 AM UTC

[deleted]

Re: Tosheets, utility to send stdin to Google sheets

#15

Post by nurettin » Sat, Nov 18, 2017, 8:57 AM UTC

sillysaurus3 wrote: post #12

gcr wrote: post #11

Earlier quoted context omitted.

With a domain-specific tool, it's even easier though. curl ... | jq -r .last

Sure. But you can't use jq to scrape arbitrary websites, for example. :)

For cases where a website is not a tutorial for websites, regex is a suitable tool for scraping.

Re: Tosheets, utility to send stdin to Google sheets

#16

Post by tardo99 » Sat, Nov 18, 2017, 10:24 AM UTC

They mean stdout, right?

Re: Tosheets, utility to send stdin to Google sheets

#17

Post by forkerenok » Sat, Nov 18, 2017, 10:57 AM UTC

tardo99 wrote: post #16

They mean stdout, right?

Depends on from where you look :)

It is stdout for the previous process in the pipeline and stdin for the tosheets itself.

EDIT: Tosheets -> tosheets

Re: Tosheets, utility to send stdin to Google sheets

#18

Post by O_H_E » Sat, Nov 18, 2017, 12:28 PM UTC

Interestingly Nice

Your project ruins my English

Re: Tosheets, utility to send stdin to Google sheets

#19

Post by fiatjaf » Sat, Nov 18, 2017, 1:40 PM UTC

Amazing.

We need more utilities like this that help integrate apps and web services between themselves and the Unix environment.

"Pipes to the web" should be like this. Not bloted a UI with forms that perform premade actions with your web apps data.

Re: Tosheets, utility to send stdin to Google sheets

#20

Post by dpflan » Sat, Nov 18, 2017, 1:52 PM UTC

sillysaurus3 wrote: post #12

gcr wrote: post #11

Earlier quoted context omitted.

With a domain-specific tool, it's even easier though. curl ... | jq -r .last

Sure. But you can't use jq to scrape arbitrary websites, for example. :)

Jeff Atwood has an entertaining post about parsing HTML with regular expressions:

https://blog.codinghorror.com/parsing-html-the-cthulhu-way/

“”” That's right, if you attempt to parse HTML with regular expressions, you're succumbing to the temptations of the dark god Cthulhu's … er … code. “””