Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

CSVJSON – Self Rise of an Online Tool

medium.com

Post reply on HN
Print view View original

21–30 of 36 posts

Re: CSVJSON – Self Rise of an Online Tool

#21

Post by martin_drapeau »

me_bx wrote: post #15
userbinator wrote: post #11

Having actually written something like this before --- and it remains on my machine as an executable of only a few kilobytes --- I'm curious about the thought process that could lead to someone uploading a considerable volume of potentially sensitive CSV data to this site, and then downloading a proportionally larger amount of JSON from it. The site doesn't even appear to support HTTPS.

Technically, all the file processing can happen client-side now, thanks to the HTMl5 file API. Users' data doesn't have to leave the browser. [shameless plug] This is the approach I have taken creating a similar converter (which also works offline): http://mango-is.com/tools/csv-to-json/

Yes, that is a good idea. However I chose to upload it in order to allow sharing the conversion via a unique generated URL.

Re: CSVJSON – Self Rise of an Online Tool

#22

Post by martin_drapeau »

duncans wrote: post #14

FYI: The term I search for when needing something along these lines is "JSON prettify"

Interesting. I had never considered that search term. The volumne is low (Google AdWords Keyword Planner shows a 2,400 search volume per month, 10% of JSON beautifer). Yet it is a keyword I will add. Thanks!

Re: CSVJSON – Self Rise of an Online Tool

#23

Post by martin_drapeau »

hayksaakian wrote: post #8

from 15000 quality page views you should expect at least $15 of revenue ($1 CPM) even higher numbers from developers (valuable users). Check out something like https://carbonads.net/ and it might at least pay for your hosting. It's invite only though, so you might have to ask for an invitation.

Personally I hate it when ads get in my way. Like anyone else, I do like money though. So I'm struggling with trying to monetize this. I don't want to annoy developers.

This being said, I will consider trying carbonads. Thanks for the tip.

Re: CSVJSON – Self Rise of an Online Tool

#24

Post by yareally »

EvanPlaice wrote: post #17
yareally wrote: post #10

Earlier quoted context omitted.

> BTW, does anyone know of a tool to do the reverse? I created a java/scala library[1] (source is scala, but there's a jar with dependencies for java) a few years ago for an Android app I was hired to work on that converts nested JSON to CSV. I was allowed to open source the library later on and released it under the MIT License, so anyone can use it now. Never thought anyone else would ever need to convert json to c…

Yes. Use the built-in JSON.parse() to get the data into memory, then use my jquery-csv library's $.csv.fromArrays() to format the data as CSV. Guess I found a good candidate for a blog post. It's amazing How much I see others struggle with such a aimple concept.

Not sure if you parsed my comment incorrectly or you meant to reply to someone else :)

Re: CSVJSON – Self Rise of an Online Tool

#25

Post by plugnburn »

martin_drapeau wrote: post #21
me_bx wrote: post #15

Earlier quoted context omitted.

Technically, all the file processing can happen client-side now, thanks to the HTMl5 file API. Users' data doesn't have to leave the browser. [shameless plug] This is the approach I have taken creating a similar converter (which also works offline): http://mango-is.com/tools/csv-to-json/

Yes, that is a good idea. However I chose to upload it in order to allow sharing the conversion via a unique generated URL.

Why not use location.hash and URL shortener? That way no upload is needed.

Re: CSVJSON – Self Rise of an Online Tool

#26

Post by EvanPlaice »

yareally wrote: post #24
EvanPlaice wrote: post #17

Earlier quoted context omitted.

Yes. Use the built-in JSON.parse() to get the data into memory, then use my jquery-csv library's $.csv.fromArrays() to format the data as CSV. Guess I found a good candidate for a blog post. It's amazing How much I see others struggle with such a aimple concept.

Not sure if you parsed my comment incorrectly or you meant to reply to someone else :)

Somehow missed the 'java/scala part'.

Either way, why do 2 data format transforms as one lib? It makes more sense to parse JSON into memory in one step then format it as CSV in a separate step.

Ie, what about the 'Single Responsibility Principle'?

Re: CSVJSON – Self Rise of an Online Tool

#27

Post by kawera »

jsnell wrote: post #7
kawera wrote: post #3

Thanks, I've used your tool a few times and it works beautifully. Quite interesting article too from the SEO pov. BTW, does anyone know of a tool to do the reverse? I have some json files with deeply nested arrays and would like to output a csv file with one line for each "leaf". I can write it myself but would be happy to use an existing tool.

One that I wrote a while ago, which might or might not do what you want: https://github.com/jsnell/json-to-multicsv Note that the mapping from nested / hierarchical JSON file to CSV file(s) is not as obvious as it is the other way around. There's some configuration involved. I wrote a blog post about that particular aspect: https://www.snellman.net/blog/archive/2016-01-12-json-to-mul...

I tried but json-to-multicsv didn't really solve this particular case as I have some weird json files. Not been well versed in perl, I ended up writing a little script in python and, for that, your blog post was very helpful, thank you!

Re: CSVJSON – Self Rise of an Online Tool

#28

Post by kawera »

yareally wrote: post #10
kawera wrote: post #3

Thanks, I've used your tool a few times and it works beautifully. Quite interesting article too from the SEO pov. BTW, does anyone know of a tool to do the reverse? I have some json files with deeply nested arrays and would like to output a csv file with one line for each "leaf". I can write it myself but would be happy to use an existing tool.

> BTW, does anyone know of a tool to do the reverse? I created a java/scala library[1] (source is scala, but there's a jar with dependencies for java) a few years ago for an Android app I was hired to work on that converts nested JSON to CSV. I was allowed to open source the library later on and released it under the MIT License, so anyone can use it now. Never thought anyone else would ever need to convert json to c…

Tons of old systems won't accept json but happily ingest csv/tsv - the need to convert json to csv isn't rare depending on your environment. Thanks for the library, will probably be useful in the future.

Re: CSVJSON – Self Rise of an Online Tool

#29

Post by kawera »

matthewmacleod wrote: post #6
kawera wrote: post #3

Thanks, I've used your tool a few times and it works beautifully. Quite interesting article too from the SEO pov. BTW, does anyone know of a tool to do the reverse? I have some json files with deeply nested arrays and would like to output a csv file with one line for each "leaf". I can write it myself but would be happy to use an existing tool.

jq ( https://stedolan.github.io/jq/ ) is a great tool for general JSON manipulation. It includes a CSV export filter, so you can run commands like: jq -r '. | map(.key), map(.value) | @csv' which will output a JSON array as CSV.

Very elegant solution, thank you. jq is indeed a powerful tool but it can get hairy with obnoxiously intricate json files/streams.
Post reply on HN