Live data from Hacker News

Scuba: Diving into Data at Facebook [pdf]

research.fb.com

31–40 of 44 posts

Re: Scuba: Diving into Data at Facebook [pdf]

#32
Hello everyone, Need hacking services? contact: successhackers5@gmail.com Be warned, most of these so called hackers here are impostors, I know how real hackers work, they never advertise themselves in such a credulous manners and they are always discrete. I’ve been scammed so many times out of desperation trying to find urgent help to change my school grades, finally my friend introduced me to a group of reliable hackers who work with discretion and delivers promptly, they do all kinds of hackings ranging from; - Sales of Blank ATM cards. - University or school grades changing - Bank accounts hack and funds transfer - Erase criminal records hack - Facebook hack,Twitters hack - email accounts hack, gmail, yahoomail, hotmail etc. - Skype hack - Databases hack - Word Press Blogs hack - Individual computers hack - Control devices remotely hack - Verified Paypal Accounts hack - Android & iPhone Hack etc. But they helped me; - Changed my school grades - Hacked my cheating ass girlfriend email facebook - The most of it all, they helped me with Western union money transfer and i tracked and confirm the money before i paid him their fees. I have made them my permanent hackers and you can as well enjoy their services. You can contact them at: successhackers5@gmail.com for any hacking services and also endeavor to spread the good news on how they helped you.

Re: Scuba: Diving into Data at Facebook [pdf]

#33
Hello everyone, Need hacking services? contact: successhackers5@gmail.com Be warned, most of these so called hackers here are impostors, I know how real hackers work, they never advertise themselves in such a credulous manners and they are always discrete. I’ve been scammed so many times out of desperation trying to find urgent help to change my school grades, finally my friend introduced me to a group of reliable hackers who work with discretion and delivers promptly, they do all kinds of hackings ranging from; - Sales of Blank ATM cards. - University or school grades changing - Bank accounts hack and funds transfer - Erase criminal records hack - Facebook hack,Twitters hack - email accounts hack, gmail, yahoomail, hotmail etc. - Skype hack - Databases hack - Word Press Blogs hack - Individual computers hack - Control devices remotely hack - Verified Paypal Accounts hack - Android & iPhone Hack etc. But they helped me; - Changed my school grades - Hacked my cheating ass girlfriend email facebook - The most of it all, they helped me with Western union money transfer and i tracked and confirm the money before i paid him their fees. I have made them my permanent hackers and you can as well enjoy their services. You can contact them at: successhackers5@gmail.com for any hacking services and also endeavor to spread the good news on how they helped you.

Re: Scuba: Diving into Data at Facebook [pdf]

#34

The engineer who built this, Lior Abraham, went on to start data analytics startup Interana (YC W13).

Yes, indeed. Cofounded with Ann Johnson and fellow ex-Facebooker, Bobby Johnson, who led the infrastructure team for many years.

Interana draws much of it's inspiration from Scuba combined with learnings of analyzing massive amounts of data at scale.

Many high-growth companies use Interana for behavioral analysis of their event logs (Asana, Reddit, Imgur, Nextdoor, Bing, Azure, Tinder, SurveyMonkey, Sonos...).

Re: Scuba: Diving into Data at Facebook [pdf]

#35
post #12

How does Scuba differ from Presto which is also developed by Facebook? It seems that it stores data in-memory and have data expiration feature but also has many common features such as SQL and distributed processing.

Here is a great post from Bobby Johnson (ex-Facebooker and CTO of Interana) with his opinion on "in-memory" data stores: https://community.interania.com/t5/Blogs/The-Myth-of-In-Memo....

This was the reasoning behind a very key architectural decision at Interana that makes it different than Scuba - instead of developing an in memory system, Interana created a custom data store that is heavily optimized around using spinning disk and CPU cache. This makes it incredibly fast and less expensive to operative massive clusters at scale.

Re: Scuba: Diving into Data at Facebook [pdf]

#37
post #17

Earlier quoted context omitted.

I really miss the awesome tooling like Scuba since I left.

I'll second the post above -- if you miss Scuba, honeycomb.io is for you. https://honeycomb.io/blog/2016/11/honeycomb-faq-in-140-chars...

There's also Snorkel, mostly written by Okay Zed (one of the authors listed on that Scuba paper) http://snorkel.logv.org/

Re: Scuba: Diving into Data at Facebook [pdf]

#38

There's also a blog post about it here https://www.facebook.com/notes/facebook-engineering/under-th... My YC company https://www.interana.com took a lot of lessons from this and is doing something that I think is even better for cos like Reddit, Sonos, Comcast, Bing. You can sign up if you'd like a demo :)

It would be really nice if I didn't have to fill out a form to see a demo-- having used Scuba I'd love to advocate for Interana at my current company, but it keeps getting pushed down my TODO list because of the extra friction

Re: Scuba: Diving into Data at Facebook [pdf]

#40
post #39

So it samples data less than or equal to a second old and at a rate determined by the person making the query? I wonder how often the data is inaccurate given the potentially low sample size?

Not sure where you got the "less than or equal to a second old"? Maybe I'm misunderstanding what you mean?

There is no single system-wide imposed sampling rate, so it's up to you to set the sampling rate based on what sort of queries you want to be able to do with good enough accuracy. We have 1:1 rate data for some things (say errors served on a particular service), while a ten or a hundred thousand to one data for other things where there are, say, tens of millions of log lines per second.

Post reply on HN