Earlier quoted context omitted.
We have a pretty big e-commerce scraping project, and we don't really run into many problems regarding blacklisted ip's. There are a few sites who we get consistent bans from, but with elastic ip's it's pretty much a non-issue. I have yet to see a site that ban's all amazon ip's.
I run http://whirlpool.net.au and I religiously check the Amazon EC2 forum announcements[1] for new IP ranges to ban. [1] https://forums.aws.amazon.com/ann.jspa?annID=1030
AWS drops bandwidth pricing
41–50 of 96 posts
Re: AWS drops bandwidth pricing
#42My blogpost w background information: http://wv.ly/iLDaqu
Re: AWS drops bandwidth pricing
#43I'm blown away. This radically changes the cost for one of my core products (automated browsing from EC2 machines). I've thought for a long time that EC2 was getting comparatively very expensive for bandwidth (simply not decreasing their prices). I thought they would have to change it, but I didn't expect free!
I wouldn't be surprised if they put a fair use clause somewhere. Otherwise you could hypothetically run a fairly resource intensive bot that scrapes data 24x7 using up aws download bw for no cost.
For example, if you start up a micro instance, you'll only be able to download at like 200kbps or something.
So I'd assume the connection speed is linked to the size of the instance, and the bandwidth cost is integrated into that cost somewhat.
Re: AWS drops bandwidth pricing
#44Dropbox must be super happy that half their bandwidth costs have disappeared!
Re: AWS drops bandwidth pricing
#45Re: AWS drops bandwidth pricing
#46Making all in-bound traffic free is a super-aggressive (and much appreciated) move. As blhack pointed out Voxel's per-GB rate[1] before AWS dropped was extremely competitive, but they charge for in and out-bound data. AWS, after the 1st of July will only charge $0.12 for out-bound data and $0.00 for inbound data, effectively making it something like $0.06/GB compared to Voxel (I'm hand-waving this a bit to make a poi…
Re: AWS drops bandwidth pricing
#47Earlier quoted context omitted.
We have a pretty big e-commerce scraping project, and we don't really run into many problems regarding blacklisted ip's. There are a few sites who we get consistent bans from, but with elastic ip's it's pretty much a non-issue. I have yet to see a site that ban's all amazon ip's.
I run http://whirlpool.net.au and I religiously check the Amazon EC2 forum announcements[1] for new IP ranges to ban. [1] https://forums.aws.amazon.com/ann.jspa?annID=1030
Name me one good reason. Name me one.
Re: AWS drops bandwidth pricing
#48Earlier quoted context omitted.
I run http://whirlpool.net.au and I religiously check the Amazon EC2 forum announcements[1] for new IP ranges to ban. [1] https://forums.aws.amazon.com/ann.jspa?annID=1030
Why? Name me one good reason. Name me one.
Shitloads of rogue bots stealing content for black-hat SEO.
Shitloads of rogue bots harvesting email addresses.
Shitloads of rogue bots submitting spammy replies.
Re: AWS drops bandwidth pricing
#49Earlier quoted context omitted.
I wouldn't be surprised if they put a fair use clause somewhere. Otherwise you could hypothetically run a fairly resource intensive bot that scrapes data 24x7 using up aws download bw for no cost.
Instances are already IO bound/capped. For example, if you start up a micro instance, you'll only be able to download at like 200kbps or something. So I'd assume the connection speed is linked to the size of the instance, and the bandwidth cost is integrated into that cost somewhat.
Re: AWS drops bandwidth pricing
#50For another comparison, voxel.net (which serves imgur): http://www.voxel.net/pricing $0.10/GB up to 40TB $0.07/GB up to 500TB $0.05/GB >500TB This looks like the cheapest "real" CDN I've seen. Awesome :) Not that I need it [yet], but here's to hoping :)