Akamai blocks unordered HTTP request headers
gwillem.gitlab.io
Akamai blocks unordered HTTP request headers
1–10 of 16 posts
Re: Akamai blocks unordered HTTP request headers
#2[deleted]
Re: Akamai blocks unordered HTTP request headers
#3In the second example the author does the following:
$ ACCEPT="text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8"
$ curl -v -H "$UA" -H "$ACCEPT" $URL |& grep ' $ curl -v -H "$UA" -H "Accept: $ACCEPT" $URL |& grep 'Re: Akamai blocks unordered HTTP request headers
#4Is it Akamai? Or is it a single site on Akamai? CDN customers can configure their sites in a million ways.
My guess is a single site that was getting DDoS'd added this as an attack signature and forgot about it.
Re: Akamai blocks unordered HTTP request headers
#5In the second example the author does the following: $ ACCEPT="text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" $ curl -v -H "$UA" -H "$ACCEPT" $URL |& grep ' The author fails to prefix $ACCEPT with the actual header key. It should be: $ curl -v -H "$UA" -H "Accept: $ACCEPT" $URL |& grep '
[deleted]
Re: Akamai blocks unordered HTTP request headers
#6Is it Akamai? Or is it a single site on Akamai? CDN customers can configure their sites in a million ways. My guess is a single site that was getting DDoS'd added this as an attack signature and forgot about it.
This is just a single sites configuration.
Re: Akamai blocks unordered HTTP request headers
#7[deleted]
Re: Akamai blocks unordered HTTP request headers
#8This is just the configuration for a single site. The author did not even try it against www.akamai.com:
$ URL=http://www.akamai.com
$ UA="User-Agent: Mozilla/5.0 My API Client"
$ ACCEPT="Accept: /"
$ curl -v -H "$UA" -H "$ACCEPT" $URL
https://www.akamai.com
< Connection: keep-alive
Re: Akamai blocks unordered HTTP request headers
#9Did Akamai recently just make this change?
I'm asking because I've been running a web crawler for years now, and in the past week, I have noticed that the crawler is being rejected in more websites then usual.
Re: Akamai blocks unordered HTTP request headers
#10In the second example the author does the following: $ ACCEPT="text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" $ curl -v -H "$UA" -H "$ACCEPT" $URL |& grep ' The author fails to prefix $ACCEPT with the actual header key. It should be: $ curl -v -H "$UA" -H "Accept: $ACCEPT" $URL |& grep '
From personal experience I'd be willing to give him the benefit of the doubt (i.e. he did it right, but wrote it up wrong). Good spot though.