Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

blog.cloudflare.com

Post reply on HN
Print view View original

121–130 of 168 posts

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#121

Post by pnpnp »

judge2020 wrote: post #81
ludjer wrote: post #80

Earlier quoted context omitted.

Anyone doing serious traffic with AWS will use cloud front and then you get additional savings on-top of that and you can negotiate a better rate then provided depending on usage so some people pay way less then the advertised price.

Sure, if you're a business that has to burn money on servers anyways, but a lot of people avoid AWS for side-projects and non-business applications because it can easily balloon to over $100/month with just a few services and moderate traffic.

Counter-point: it can also be extremely cheap.

I’m in a seemingly small subset of people that is very happy with AWS for side projects. Granted I’m not doing anything that requires many resources.

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#122

Post by NicoJuicy »

ethbr1 wrote: post #59
sylvain_kerkour wrote: post #37

Great to finally see this here! Cloudflare is the 4th major cloud platform that (almost) nobody is seeing coming, and I believe that they will even surpass Google Cloud Platform's sooner than expected. The only problem that remains is their support... I'm writing a book about Cloudflare (launching very soon) where I share this and many other things to scale faster all while saving big on your cloud bills. You can joi…

100% agreed. The most consistently amazing thing about Cloudflare is the clarity of their product positioning. You have this common problem, we built a thing to fix it. No 'change your problem into this other problem' gymnastics. Just 'pay us once you exceed the free tier, and it's no longer a problem'. And furthermore, they seem to have clarity of platform vision, in that each piece does something very specific to h…

If you want to read more about their financials of Q2, I found this very interesting:

https://softwarestackinvesting.com/cloudflare-net-q2-2023-ea...

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#123

Post by NicoJuicy »

solatic wrote: post #101
sylvain_kerkour wrote: post #37

Great to finally see this here! Cloudflare is the 4th major cloud platform that (almost) nobody is seeing coming, and I believe that they will even surpass Google Cloud Platform's sooner than expected. The only problem that remains is their support... I'm writing a book about Cloudflare (launching very soon) where I share this and many other things to scale faster all while saving big on your cloud bills. You can joi…

Support and also all-around enterprise readiness. Even on the enterprise tier, their permissions management is a pale shadow of what IAM grants you on AWS or GCP, to the point where you will put your compliance as risk. No documentation on setting up SAML/SSO for their management console. It's very, very clear that their internal growth engines are set to ludicrous growth rates (to try and justify their outrageous st…

I think they made their permission system much more fine grained during developer week.

Is your info still up to date? ( I'm not following this topic too much, but I do remember some things passing by).

---

Additionally, most of their investors are companies and not private.

There's a lot going on. One of the improvements that they did was in the sales department.

If those previous sales that were severely underperforming are now replaced by even average sales. Then expect a big rise in sales for Q3.

Reference: https://softwarestackinvesting.com/cloudflare-net-q2-2023-ea...

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#124

Post by ipaddr »

lolinder wrote: post #113
ipaddr wrote: post #95

Earlier quoted context omitted.

How would you deal with an attack though residential US proxies? Your method falls apart. How many of us deal with automated password attacks is to issue questions that only locals or people with specific knowledge could answer. Change the questions and do everything custom.

It sounds like they have behavior-oriented rules that are just always triggered on Tor because Tor traffic has a disproportionate amount of bot traffic. I see no reason why behavioral blocking breaks down when an attack comes from an IP space that is usually more benign. > How many of us deal with automated password attacks is to issue questions that only locals or people with specific knowledge could answer. Change…

It is used commonly with facebook groups. Having to answer a question related to the group topic filters out spammers. I do it for country specific country sites requiring knowledge. The information can be googled if desire is high.

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#125

Post by candiddevmike »

pzmarzly wrote: post #4

It's a seemingly simple and obvious way to lazily migrate your data, but if using Sippy means one less thing for the application code to worry about, and (I assume) is a free add-on, then it provides a ton of value. I have to admit that Cloudflare has been killing it recently with DevX / OpsX. If I wasn't against that company's role in modern internet (as a user of Tor, their firewall is annoying to no end), I would…

Biggest gap with Cloudflare IMO is granularity of API permissions for tokens. I wish I could create an API token that only grants write across to a specific DNS entry (or regex of a DNS entry).

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#126

Post by candiddevmike »

solatic wrote: post #94
linsomniac wrote: post #86

Is Cloudflare requiring you to switch to Enterprise plans if your usage is above some threshold? In a previous discussion on HN about Cloudflare, a good half dozen people replied saying they got calls when their usage increased above some level that they had to switch to an enterprise plan, and AFAIK those start at $5K/month (from a brief talk with sales a few weeks ago). We have tens of TB in AWS that we'd like to m…

$5k/month is just Cloudflare's opening bid. In Enterprise sales, you are expected to negotiate for a discount. Common rule of thumb is that Enterprise sales (in general, across vendors) start at ~$2k/month (this is what's necessary to pay for salespeople's salaries) and savvy negotiators will end up close to that figure for bare-bones plans.

In what world does 2k/month pay a sales persons salary? And what enterprise sales person is OK selling something for $2k/month/$24k/year when they carry a quota 20-50x that amount?

Enterprise deals start at 100-200k/year, minimum, IME.

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#127

Post by lolinder »

ipaddr wrote: post #124
lolinder wrote: post #113

Earlier quoted context omitted.

It sounds like they have behavior-oriented rules that are just always triggered on Tor because Tor traffic has a disproportionate amount of bot traffic. I see no reason why behavioral blocking breaks down when an attack comes from an IP space that is usually more benign. > How many of us deal with automated password attacks is to issue questions that only locals or people with specific knowledge could answer. Change…

It is used commonly with facebook groups. Having to answer a question related to the group topic filters out spammers. I do it for country specific country sites requiring knowledge. The information can be googled if desire is high.

Facebook groups I can see, especially because they're often surrounding specific niche topics that you can reasonably expect people to have some shared knowledge of, and the administrator of a Facebook group doesn't have that many levers to pull to reduce spam.

At the country level (and for applications where you have enough control over your infrastructure to use a real firewall) I question both the efficacy and accessibility of a system like you propose—it's not that different from the old style "what is 2+2" CAPTCHAs, and there's a good reason why most applications have moved on from those. They're not a serious alternative to behavioral rules like what OP describes.

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#128

Post by [deleted] »

taw1516 wrote: post #120
NicoJuicy wrote: post #106

Earlier quoted context omitted.

Yeah https://developers.cloudflare.com/images/image-resizing/ https://developers.cloudflare.com/images/image-resizing/url-... Example: src="/cdn-cgi/image/width=80,quality=75/uploads/avatar1.jpg About /cdn-cgi/image/ It's a fixed prefix that identifies that this is a special path handled by Cloudflare’s built-in Worker. --- Price at Cloudflare : 50,000 monthly resizing requests included with Pro, Business. $9 per add…

that is a lot cheaper than Vercel in term of store image but egress seems expensive since they charge per cache image served as well. Do you know if Cloudinary is a better option?

[deleted]

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#129

Post by NicoJuicy »

taw1516 wrote: post #120
NicoJuicy wrote: post #106

Earlier quoted context omitted.

Yeah https://developers.cloudflare.com/images/image-resizing/ https://developers.cloudflare.com/images/image-resizing/url-... Example: src="/cdn-cgi/image/width=80,quality=75/uploads/avatar1.jpg About /cdn-cgi/image/ It's a fixed prefix that identifies that this is a special path handled by Cloudflare’s built-in Worker. --- Price at Cloudflare : 50,000 monthly resizing requests included with Pro, Business. $9 per add…

that is a lot cheaper than Vercel in term of store image but egress seems expensive since they charge per cache image served as well. Do you know if Cloudinary is a better option?

Tbh. I'm mostly following Cloudflare + azure.

I checked quickly and cloudinary works with credits. Cloudflare mentions 1$ / 100 k. Images served, which seems pretty cheap to me.

The pricing I mentioned was for image manipulation, eg. Resizing ( not storage), which was what was asked.

I doubt they are cheaper though.

Re: Cloudflare Sippy: Incrementally Migrate Data from AWS S3 to Reduce Egress Fees

#130

Post by HatchedLake721 »

ludjer wrote: post #77
toomuchtodo wrote: post #71

Earlier quoted context omitted.

Deletes are free, but you have to pay to list to delete if not individually tracking.

Turn on weekly manifest to get a list of files and then you can delete based off that. Much faster and better then listing billions of files.

What’s a weekly manifest?
Post reply on HN