How to build a data mining web app?

#1

Post by zeratul » Fri, Dec 02, 2011, 3:28 PM UTC

How to build a data mining web app?
github.com

Re: How to build a data mining web app?

#2

Post by mapleoin » Fri, Dec 02, 2011, 4:16 PM UTC

I must be stupid, but I just can't wrap my head around this three-axis-in-a-2D-space graph: http://hnpickup.appspot.com/

Is this normal?

Re: How to build a data mining web app?

#3

Post by zeratul » Fri, Dec 02, 2011, 4:35 PM UTC

mapleoin wrote: post #2

I must be stupid, but I just can't wrap my head around this three-axis-in-a-2D-space graph: http://hnpickup.appspot.com/ Is this normal?

If you click on the question mark in the top right corner you will get the definitions. More documentation is in the source code.

EDIT: As I say in the "warning" section of the readme file: usually it's not a good idea to show the raw data because it will confuse the end user. And if you add more explanation you will cause clutter and cognitive overload. I show the raw data mostly for people that want to dig into the source code.

Re: How to build a data mining web app?

#4

Post by eschutte2 » Fri, Dec 02, 2011, 4:39 PM UTC

mapleoin wrote: post #2

I must be stupid, but I just can't wrap my head around this three-axis-in-a-2D-space graph: http://hnpickup.appspot.com/ Is this normal?

Maybe think of it as two different graphs with the same x-axis, superimposed?

Re: How to build a data mining web app?

#5

Post by spicyj » Fri, Dec 02, 2011, 4:42 PM UTC

A tip: if you rename README.txt to README.markdown and change the headers to look like:

  # Section Header

  Paragraph text.

then GitHub will render it nicely.

Re: How to build a data mining web app?

#6

Post by ColdAsIce » Fri, Dec 02, 2011, 5:07 PM UTC

This is gold! Thank you so much!

Re: How to build a data mining web app?

#7

Post by zeratul » Fri, Dec 02, 2011, 6:30 PM UTC

spicyj wrote: post #5

A tip: if you rename README.txt to README.markdown and change the headers to look like: # Section Header Paragraph text. then GitHub will render it nicely.

Thank you.

btbytes did the md formatting for me. I will accept the pull request as soon as I get home.

Re: How to build a data mining web app?

#8

Post by rossmasters » Fri, Dec 02, 2011, 7:20 PM UTC

eschutte2 wrote: post #4

mapleoin wrote: post #2

I must be stupid, but I just can't wrap my head around this three-axis-in-a-2D-space graph: http://hnpickup.appspot.com/ Is this normal?

Maybe think of it as two different graphs with the same x-axis, superimposed?

That's all this is really. The left Y axis applies to the sets that involve an average score, the right Y axis applies to pickup ratio only.

That said, what is a pickup ratio? Some sort of measure of extra votes over time?

Re: How to build a data mining web app?

#9

Post by salimmadjd » Fri, Dec 02, 2011, 7:35 PM UTC

Be warned! Google App Engine Pricing has gone up by as much as 500% since Nov 7. The code is based on GAE and you just need be warned that if you spend time and build around it, be ready for some crazy billing. I'm talking from personal experience :(

Re: How to build a data mining web app?

#10

Post by zeratul » Fri, Dec 02, 2011, 7:49 PM UTC

salimmadjd wrote: post #9

Be warned! Google App Engine Pricing has gone up by as much as 500% since Nov 7. The code is based on GAE and you just need be warned that if you spend time and build around it, be ready for some crazy billing. I'm talking from personal experience :(

Yes!!! I was hoping to have pay-per-impression advertisement that would pay the bill but apps which don't offer wordy clutter are not allowed to have ads. I was rejected by adSense, BuySellAds, and adBrite. Sometimes I think we build Internet for robots not for humans.

I have ~100 visits per day. That costs me ~$0.10 per day.

More details here:

https://github.com/entaroadun/hnpickup/wiki/Hacker-News-Pick...