Live data from Hacker News

My data is bigger than your data

lintool.github.io

11–14 of 14 posts

Re: My data is bigger than your data

#13
post #8

I am not sure if size of data and clusters is something people could brag about as if it is "bigger the better". I am more interested in seeing what kind of engineering efforts they are putting to minimize the size of data and clusters.

Soooo true. In my former life I frequently came across traders or quantitative analysts who wanted to use "big data stuff" to analyze their stupid ideas. I never gave these people clusters of Hapoops or whatever they'd been reading about on the blogs. Usually what I did is reformatted their data files into column-oriented systems (like Vertica) or varint+delta-encoded timeseries that would fit into a single CPU's cache memory.

Re: My data is bigger than your data

#14
"We do Little Data here."

Said no dev team ever.

Who in the world wants to work with little or mildly large data? No one. Everyone does Big Data. I've used the word too when processing It is really just a fad word at this point "Cloud". *aaS, or how "Object Oriented" was.

Post reply on HN