Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

JSON Hero: Enhanced JSON structure visualization

jsonhero.io

Post reply on HN
Print view View original

181–190 of 203 posts

Re: JSON Hero: Enhanced JSON structure visualization

#181

Post by syngrog66 »

einichi wrote: post #31

My number one requirement for a tool like this is that the JSON content never leaves the machine it's on. I can only imagine the kind of personal information or proprietary internal data that has been unwittingly transmitted due to tools like this. If my objective was to gain the secrets of various worldwide entities, one of the first things I would do is set up seemingly innocent Pastebins, JSON checkers, online fil…

yep if I were a Bad Guy and had nation state resources I'd be salivating over trying to get "in" at JetBrains, GitHub and the like

Re: JSON Hero: Enhanced JSON structure visualization

#183

Post by DataOverload »

chopin wrote: post #100
osrec wrote: post #97

As far as I'm concerned, JSON doesn't suck! For all its shortcomings, I still find it clear and easy to read, and when gzipped, it compresses reasonably well over the wire, especially when you have a bunch of repeated property names in arrays etc. Nice tool, but like others have said, I'm pretty comfortable reading JSON in my editor.

If JSON had comments, I'd be fine with it.

No post body was provided.

Re: JSON Hero: Enhanced JSON structure visualization

#184

Post by informalo »

remram wrote: post #154
informalo wrote: post #124

Earlier quoted context omitted.

You can do that with Chrome dev tools: Network -> No throttling -> Offline Don't know how reliable this is though or whether a web developer could work around this.

It could be storing data and send it later when you visit the same origin from a different tab. Unless you were also using incognito or throwaway tab containers to discard stored data.

Good point, thanks.

Re: JSON Hero: Enhanced JSON structure visualization

#185

Post by Existenceblinks »

user3939382 wrote: post #139
Existenceblinks wrote: post #128

Earlier quoted context omitted.

I think nobody writes JSON Schema by hand .. I see most of them use their lang libs to generate it. What language are you using?

I agree. That's basically what I meant by, even when the base is auto-generated. In other words: you can generate a JSON schema from an example JSON. However, if you're using that to validate, say, an API response, the auto-generate tool can't possibly know what the valid range of values might be, or how some keys will shift depending on the request. Any type of variation like that requires hand-tuning. I use it in a…

I believe a programming language can be written to generate any requirement you have on json schemas. Have you tried https://www.npmjs.com/package/ts-json-schema-generator and see what you can't do?

I built a json schema editor gui saas, and my conclusion is no one is buying because they use lang libs to generate it. So I kinda surprise you said you wanted an editor.

Re: JSON Hero: Enhanced JSON structure visualization

#186

Post by user3939382 »

Existenceblinks wrote: post #185
user3939382 wrote: post #139

Earlier quoted context omitted.

I agree. That's basically what I meant by, even when the base is auto-generated. In other words: you can generate a JSON schema from an example JSON. However, if you're using that to validate, say, an API response, the auto-generate tool can't possibly know what the valid range of values might be, or how some keys will shift depending on the request. Any type of variation like that requires hand-tuning. I use it in a…

I believe a programming language can be written to generate any requirement you have on json schemas. Have you tried https://www.npmjs.com/package/ts-json-schema-generator and see what you can't do? I built a json schema editor gui saas, and my conclusion is no one is buying because they use lang libs to generate it. So I kinda surprise you said you wanted an editor.

For my use case that doesn't really help at all. So I'm doing request/response in JSON with a third-party API and I want to programmatically detect if their response is valid, not based on any rules the API can know, but based on the context of my integration. So I use JSON schema to define what valid responses (for my particular application/integration) look like.

How I do this now, is to get an example response, auto-generate the schema using a tool like this https://extendsclass.com/json-schema-validator.html and then hand-tune from there. In some cases the same endpoint response can have huge variations depending on the request so it's very tedious doing this by hand.

A variation on the tool above that would help a lot would be if I could provide multiple example JSONs and it could return a schema that validates all of them.

JSON schema is used in MySQL now natively, it's used in PHP, and from what I can tell a lot of other languages. The package you linked to assumes you're generating it from JS/TS. As JSON becomes even more popular as a data interchange format I think that assumption will be less true.

This is just a complete guess, but maybe your tool wasn't getting traction just because it's so early in the life of JSON Schema. There's not even a final stable version 1 yet.

Re: JSON Hero: Enhanced JSON structure visualization

#187

Post by alias_neo »

einichi wrote: post #164
ilyt wrote: post #156

Earlier quoted context omitted.

I vaguely remember some tool that was just a collection of random tools like that running as local server (including a bunch of crypto primitives) but I can't remember the name now...

You’re probably thinking of the tool made by GCHQ, CyberChef https://gchq.github.io/CyberChef/

Great tool that i'd recommend any software person, techy, reverse engineer etc should self-host.

I host in in my kube cluster with all outbound connections blocked, just to be safe.

Re: JSON Hero: Enhanced JSON structure visualization

#188

Post by Existenceblinks »

user3939382 wrote: post #186
Existenceblinks wrote: post #185

Earlier quoted context omitted.

I believe a programming language can be written to generate any requirement you have on json schemas. Have you tried https://www.npmjs.com/package/ts-json-schema-generator and see what you can't do? I built a json schema editor gui saas, and my conclusion is no one is buying because they use lang libs to generate it. So I kinda surprise you said you wanted an editor.

For my use case that doesn't really help at all. So I'm doing request/response in JSON with a third-party API and I want to programmatically detect if their response is valid, not based on any rules the API can know, but based on the context of my integration. So I use JSON schema to define what valid responses (for my particular application/integration) look like. How I do this now, is to get an example response, au…

I got you now. The data comes from an external source, and then you wanted to infer json schema from it. So I guess the json response from APIs don't have json schema defined for you. But you could define schema from their api documentation, right? It doesn't matter what tool used to generate the json schema, we only care about the result that is the schema so that you can it wherever.

Trust me on JSON Schema spec, it's been in draft for a decade, to the point they stop calling it "draft" and put date on it instead. It's a frustrating specification (I read the whole thing dozen of time because I wanted it to fully compatible .. but decided to only adopt nice subset of it)

Your use case is very niche though.

Re: JSON Hero: Enhanced JSON structure visualization

#189

Post by ilyt »

yamtaddle wrote: post #169
ilyt wrote: post #155

Earlier quoted context omitted.

It not being opt-in is the problem

If it's not opt-in, the software's spyware, pure and simple, and ought to be lumped in with other malware that should be rejected, shamed, and marginalized until/unless that behavior changes. I'm sticking to our much-better norms for this shit from c. 2000, damnit! It really is crazy how fast and completely that changed.

Well, it's not as simple. Telemetry can be something as benign as sending error report when app crashed (which generally is useful if it doesn't leak other data and leads to better app), or as intrusive as tracking every click.

The context is also important, beta test of a game's entire point is to get that data to improve the product.

Re: JSON Hero: Enhanced JSON structure visualization

#190

Post by ljw1004 »

naan_bread wrote: post #76
einichi wrote: post #31

My number one requirement for a tool like this is that the JSON content never leaves the machine it's on. I can only imagine the kind of personal information or proprietary internal data that has been unwittingly transmitted due to tools like this. If my objective was to gain the secrets of various worldwide entities, one of the first things I would do is set up seemingly innocent Pastebins, JSON checkers, online fil…

I agree. My tool flatterer: https://lite.flatterer.dev/ converts deeply nested JSON to csv/xlsx, is done in web assembly in the browser. It hard to prove that it is not sending data to a server, so it can be trusted. I know people could check dev tools but that is error prone and some users may not be able to do it. I wish there was an easy way to prove this to users as it would make online tools like this much more…

I think there is an easy way to prove this to users. Make your thing be a single page self contained html file which they save into the hard disk. Then they can trust the restricted permissions with which chrome runs such local files.

If you have a tech savvy audience they can also view your thing in an iframe with only sandbox="allow-scripts" to prove that it's not making network requests.

I wrote an html/js log viewer with those security models https://GitHub.com/ljw1004/seaoflogs - it handles up to 10kline log files decently, all locally.

Post reply on HN