Jay Kreps speaks the truth. His talk "Building LinkedIn's Real-time Data Pipeline" is along the same lines as the Log blogpost mentioned here and is also extremely informative.
Analytics at GitHub
11–17 of 17 posts
Re: Analytics at GitHub
#12Re: Analytics at GitHub
#13Earlier quoted context omitted.
any chance of you guys open-sourcing them?
Most of our graphs are pretty stock d3 code tailored for specific datasets, so I don't see much value in open sourcing them. Is there anything in particular you're interested in?
There's a need for a good charting library built on top of d3. Kind of like Highcharts, in terms of usability, but free. d3 is powerful but not as easy to use and customize as Highcharts.
Re: Analytics at GitHub
#14Earlier quoted context omitted.
Most of our graphs are pretty stock d3 code tailored for specific datasets, so I don't see much value in open sourcing them. Is there anything in particular you're interested in?
There's a need for a good charting library built on top of d3. Kind of like Highcharts, in terms of usability, but free. d3 is powerful but not as easy to use and customize as Highcharts.
Can I suggest http://www.sibdo.com For individuals it's free and built on top of d3 with some extra functionality that Higcharts does't have. You can even drag files directly onto to the visualizations and the data will render. Also really nice UI for mobile.
Re: Analytics at GitHub
#15Earlier quoted context omitted.
There's a need for a good charting library built on top of d3. Kind of like Highcharts, in terms of usability, but free. d3 is powerful but not as easy to use and customize as Highcharts.
Can I suggest http://www.sibdo.com For individuals it's free and built on top of d3 with some extra functionality that Higcharts does't have. You can even drag files directly onto to the visualizations and the data will render. Also really nice UI for mobile.
Looking at the Sibdo pricing page, it looks like much higher pricing (compared to the more established competitors) at $95 a month for use on a SINGLE website with a confusing limitation to "50 users" whatever that means.
Not only that, the example graphs and charts look very basic.
Re: Analytics at GitHub
#16Earlier quoted context omitted.
Can I suggest http://www.sibdo.com For individuals it's free and built on top of d3 with some extra functionality that Higcharts does't have. You can even drag files directly onto to the visualizations and the data will render. Also really nice UI for mobile.
Looking at the Sibdo pricing page, it looks like much higher pricing (compared to the more established competitors) at $95 a month for use on a SINGLE website with a confusing limitation to "50 users" whatever that means. Not only that, the example graphs and charts look very basic.
Good feedback thanks
It would be interesting to know what you mean by basic as we're a start-up and would appreciate any feedback.
Re: Analytics at GitHub
#17Very good article. It aligns with our envisioned architecture for our next-gen analytics platform.
So far our decision is to keep the raw events in Cassandra, and pre-aggregate most data for fast reads. Just wondering about your decision to not store raw events in Cassandra, and use raw files for that, and using Cassandra only for storing Hadoop analysis results. Do you think this decision may affect you later if you ever decide to support real-time analytics?