Free tools to help with data analysis • Hacker News Board

Re: Free tools to help with data analysis

#11

Post by ivansavz » Mon, Feb 25, 2019, 11:00 AM UTC

davedx wrote: post #3

I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk! https://datadojo.app

Interesting. Very nice to see live-updating of results like Excel.

Python fails on this transform function:

  def f(a):
      v = a if a >= 4 else 2
      return v

Message in red: "Error: (Brython compile error)"

Update: I recommend you try https://pypyjs.org/ for python in the browser.

Re: Free tools to help with data analysis

#12

Post by davedx » Mon, Feb 25, 2019, 11:08 AM UTC

ivansavz wrote: post #11

davedx wrote: post #3

I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk! https://datadojo.app

Interesting. Very nice to see live-updating of results like Excel. Python fails on this transform function: def f(a): v = a if a >= 4 else 2 return v Message in red: "Error: (Brython compile error)" Update: I recommend you try https://pypyjs.org/ for python in the browser.

Thanks! I’ll look into it. The reason I chose Brython was because it transpiles in the browser, so no server side compilation needed.

Re: Free tools to help with data analysis

#13

Post by jabberthemutt » Mon, Feb 25, 2019, 4:08 PM UTC

wodenokoto wrote: post #10

jabberthemutt wrote: post #9

Low quality listicle SEO spam for their 'courses'. Submitter is abusing HN to spam nothing but links to their site. Please avoid giving this kind of noise any attention or links.

I agree that this is very low quality. It is basically 5 of the names of 5 random tools with a generic description. What is a good way to deal with low quality submissions on HN? We can't downvote and even posting on the link is a positive signal.

I usually comment and flag.

Re: Free tools to help with data analysis

#14

Post by davedx » Wed, Feb 27, 2019, 1:19 PM UTC

ivansavz wrote: post #11

davedx wrote: post #3

I’m working on a tool somewhat similar to OpenRefine called Data Dojo. The emphasis is more on learning and experimentation, but I’m now looking into adding apache spark integration for more serious use cases. Would love any feedback from HN folk! https://datadojo.app

Interesting. Very nice to see live-updating of results like Excel. Python fails on this transform function: def f(a): v = a if a >= 4 else 2 return v Message in red: "Error: (Brython compile error)" Update: I recommend you try https://pypyjs.org/ for python in the browser.

I looked into this more. The issue is, at least in a default input, a is an array type, so you need to either access a[0] or map over it. e.g. this works:

  def f(a):
    v = a[0] if a[0] >= 4 else 2
    return v

It looks like the main issue here is getting the correct compile error from Brython. Funnily enough this seems easier to do for the PySpark version :)