Viewing profile — sllrpr

> First, let's show that I can write a job that can produce more data that it inputs. I have a map of user to score, and want to compute pair wise summed scores for every user pair…

> it was an example of one of several reasons running map reduce jobs on the AWS cloud have nothing to do with the amount input data you are moving around It would be an example if…

> Collaborative filtering. What collaborative filtering algorithm are you using that requires terabytes of intermediate storage for gigabytes of input data? I'm familiar with most …

> The point is that small inputs can have large intermediate scratch datasets and even smaller outputs. Perhaps in some rare circumstances (although not the one you cited), however…

If the best way you can think of to determine the 10 most popular search queries and their click-through rates involves terabytes of intermediate data for only 10GB of input data, …

Ugh, I thought I'd answered this but looks like HN lost my response :-( > How big is the pool of variables it can choose from? Currently it is just: screenWidth/Height, browserWidt…

> It guessed wrong for me but if the 'ExampleCount' value is accurate, you are dealing with a paucity of data. Yes, you guys are the guinea pigs, sorry about that :-) We'll need a …

It figures it out on its own. You can see the entire tree at http://cord-sa.appspot.com/dumpDT

Give it a chance, it only has a small dataset to work with so-far.

I'm happy to answer any questions - this is based on the QuickDT library (see https://github.com/sanity/quickdt ).

Many would argue that this is a flaw of C.

Thanks, good feedback. Actually, after seeking a lot of advice I'm starting to think of the deal differently - I'll update the story so everyone can benefit.

They have technology and customers.

I'm talking to a good lawyer today, they already have the LoI.

We don't really need the money, we each have other incomes that we're comfortable on. This was a speculative side-project.

No, I don't think they've signed an LoI with the other company yet.

Part of me wants to say that is a paranoid view, but I must confess that the degree to which the purchase price ramps up so quickly is a source of concern for me. $2M to $6M is a d…

I'm not sure how that could happen. We have the source code, if they renege on the agreement then we just go do something else with it and sue them if they continue to use it.

Fear not, a lawyer will review the deal before anything is signed.