Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google on today’s massive Google+ spam influx: “We ran out of disk space”

venturebeat.com

Post reply on HN
Print view View original

41–46 of 46 posts

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#41

Post by pavel_lishin »

jackowayed wrote: post #5
benologist wrote: post #3

I still have this happen, and every time I tell myself right, today I'm going to put in a warning system that'll stop this happening .... and then I clear up a ton of space and move on. HTTP.sys logging has been a real pain in my ass, every time I deploy a new server I forget to disable it and we do so much traffic it fills the drive completely overnight.

Sounds like you need to automate setting up a new server

Or at least automate the logging process. 5-minute log monitor that compresses old logs, and maybe moves them off the system onto a cloud server once space starts to run out, while also e-mailing the people responsible.

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#42

Post by ChuckMcM »

wisty wrote: post #29
riffraff wrote: post #28

Earlier quoted context omitted.

it's worse than that: among my non technical friends email is used only for "serious stuff" as talking with teachers (or students, for my friends who teach) and for work. For the others facebook messages have supplanted email. I am obviously not sure this is a global trend, but I keep using the test "who did you receive an email from, recently, who isn't work or a fellow technical person?". Results are somewhat scary…

Yeah, email is now the snail-mail of the mid-2000s.

Interesting, this means the spammers will have to change venues to reach that part of their demographic. That should be giving them something to think about.

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#43

Post by ChuckMcM »

carbonica wrote: post #13
ChuckMcM wrote: post #6

Interesting. Given the minimum size of a Colossus cluster I find the explanation Vic gives unsatisfying. That being said I'm pretty impressed with the overall product, it is the best attempt yet to unseat Facebook, and I predict it will if Facebook can't come up with a credible response quickly. The killer feature is that its blended with Gmail, and since a lot of people keep gmail open all the time it means you get…

How do you know "the minimum size of a Colossus cluster"? Are you a Google employee leaking information?

Former employee, no.

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#44

Post by ChuckMcM »

carbonica wrote: post #35
whiskers wrote: post #34

Earlier quoted context omitted.

That's a chassis for 2.5" disks so you'd be looking at 60x1TB disks, and that would mean 3 of those enclosures. Now rack them somewhere and add power - still much more than a couple of grand, we haven't even paid for the disks yet...

Yeah, I was a tad hyperbolic in just referring to the disks. I would expect the costs to be around $20/GB/year when you also factor in power - bigger drives are making a difference, but the other factors always cost more than the disks themselves. It doesn't change the fact that 60TB is tiny for a company whose every product involves storing enormous quantities of data and serving them at monstrous scale.

And according to the GFS paper their are three copies of every chunk in a GFS cluster so that is 180TB, and they probably don't depend on one GFS cluster to meet their availability guidelines so if you had two that is really 320TB (180TB * 2).

And the amazing part is if you are in an open event where Google is talking about their infrastructure in general terms you will realize that that has to be mouse nuts compared to the amount of 'spinning rust' they have going on at any one time.

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#45

Post by benologist »

pavel_lishin wrote: post #41
jackowayed wrote: post #5

Earlier quoted context omitted.

Sounds like you need to automate setting up a new server

Or at least automate the logging process. 5-minute log monitor that compresses old logs, and maybe moves them off the system onto a cloud server once space starts to run out, while also e-mailing the people responsible.

Yep that would help, notifications are built into about 1/2 my platform now ... gradually getting them more robust. :)

Re: Google on today’s massive Google+ spam influx: “We ran out of disk space”

#46

Post by carbonica »

ChuckMcM wrote: post #43
carbonica wrote: post #13

Earlier quoted context omitted.

How do you know "the minimum size of a Colossus cluster"? Are you a Google employee leaking information?

Former employee, no.

I guess dropping tidbits of inside information for HN karma will never go out of style. NDAs apply after you leave, be careful...
Post reply on HN