Live data from Hacker News

MediaCrush – A website for serving media super fast

github.com

91–99 of 99 posts

Re: MediaCrush – A website for serving media super fast

#91
post #31

I love how fast your website loads! It feels much more responsive than other, compareably minimalistic sites. How did you do it?

Nothing special, as far as I know. Our nginx config is public [1]. We serve static files directly through nginx and proxy to a gunicorn server for dynamic content. We're a single virtual private server on AWS (soon to be a single dedicated server on Voxility). [1] https://github.com/MediaCrush/MediaCrush/blob/master/config/...

Have you thought about putting Cloudflare in front of your site to reduce bandwidth consumption?

Re: MediaCrush – A website for serving media super fast

#92

Earlier quoted context omitted.

Nothing special, as far as I know. Our nginx config is public [1]. We serve static files directly through nginx and proxy to a gunicorn server for dynamic content. We're a single virtual private server on AWS (soon to be a single dedicated server on Voxility). [1] https://github.com/MediaCrush/MediaCrush/blob/master/config/...

Have you thought about putting Cloudflare in front of your site to reduce bandwidth consumption?

We have CloudFlare set up, but we only plan to turn it on to mitigate DoS attacks and help out if we run into non-malicious severe load.

Re: MediaCrush – A website for serving media super fast

#93

Earlier quoted context omitted.

Have you thought about putting Cloudflare in front of your site to reduce bandwidth consumption?

We have CloudFlare set up, but we only plan to turn it on to mitigate DoS attacks and help out if we run into non-malicious severe load.

Why not use their CDN to offload? (No snark! As an infrastructure guy, I'm always curious why people decide to do certain things certain ways)

Re: MediaCrush – A website for serving media super fast

#94

Earlier quoted context omitted.

We have CloudFlare set up, but we only plan to turn it on to mitigate DoS attacks and help out if we run into non-malicious severe load.

Why not use their CDN to offload? (No snark! As an infrastructure guy, I'm always curious why people decide to do certain things certain ways)

Well, we make a big deal about user privacy, and I don't want to give a third party access to that kind of information.

Re: MediaCrush – A website for serving media super fast

#95

Earlier quoted context omitted.

What? The MIT license is OSI approved.

You're right, it just wasn't clear you were using the MIT License.

MIT license is one of those licenses which the license text do not reference itself by name.

A bit odd, but the requirements to use the software are understood to be simple.

Re: MediaCrush – A website for serving media super fast

#96
post #48

Earlier quoted context omitted.

bcrypt is designed to thwart rainbow-table attacks. It salts the hashes and it takes a while (1/3 of a second on my machine) to compute a single hash. https://en.wikipedia.org/wiki/Bcrypt

At 1/3 of a second to compute a single hash, brute forcing the entire space of possible addresses takes around 45 CPU-years. But computing the hash of every single IP address is ridiculously parallel, so it's trivial to spin up 2k machines on EC2 and brute force the entire thing in a week. Total cost, somewhere under $8k if you don't want to bother owning real machines, less for any organization that happens to need…

And of course, they wouldn't have to test every IP address in the world, they'd only have to test the IP addresses that appeared in the webserver logs at some point, substantially reducing the time requirement.

Re: MediaCrush – A website for serving media super fast

#97

Earlier quoted context omitted.

For really reals. We're considering bumping it up to 50 MB, too.

You'd need at least 500 MB before anybody would bother.

That upload limit is per file not per account. Most people's jpg/gif/pngs doesn't approach 50MB let alone 500MB.

Re: MediaCrush – A website for serving media super fast

#98
post #97

Earlier quoted context omitted.

You'd need at least 500 MB before anybody would bother.

That upload limit is per file not per account. Most people's jpg/gif/pngs doesn't approach 50MB let alone 500MB.

Ah, for some reason I was thinking the site was for video and not images. Probably because that's what I think of when I see the term 'media'.

Re: MediaCrush – A website for serving media super fast

#99
post #96
post #48

Earlier quoted context omitted.

At 1/3 of a second to compute a single hash, brute forcing the entire space of possible addresses takes around 45 CPU-years. But computing the hash of every single IP address is ridiculously parallel, so it's trivial to spin up 2k machines on EC2 and brute force the entire thing in a week. Total cost, somewhere under $8k if you don't want to bother owning real machines, less for any organization that happens to need…

And of course, they wouldn't have to test every IP address in the world, they'd only have to test the IP addresses that appeared in the webserver logs at some point, substantially reducing the time requirement.

For what it's worth, we don't keep IPs in the http log.
Post reply on HN