Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Website with 6^16 subpages and 80k+ daily bots

news.ycombinator.com

Post reply on HN
Print view View original

201–210 of 212 posts

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#201

Post by rmbyrro »

cookiengineer wrote: post #168
rmbyrro wrote: post #124

Earlier quoted context omitted.

Sure, that's why I said "superficially looking", because the back of my head said you obviously have a conscious intention consistent overall. Would you mind elaborating more on where you draw the line between "good" and "bad" behavior when it comes to scraping? Is it obeying robots.txt, the monetary purposes (profit / non-profit)?.. I personally have a hard time accepting that a website can allow Google to scrape al…

I wanted to reply here, and actually posted the comment but then deleted it because some 4chan folks were already starting to comment here again. I wrote you an email, would love to discuss this further.

Sure thing, I see weird things here sometimes.. Haven't got your email. You can send to my username at gmail.

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#202

Post by altdataseller »

Thorrez wrote: post #150
cookiengineer wrote: post #36

First off, make a website defend mode that can be triggered to serve different content. Then, do the following: 1. Add a robots.txt, make it look like it's wordpress (Disallow: /wp-admin etc) 2. If any client requests /wp-admin, flag their IP ASN as bot. 3. If a client is a bot, send it a gzip bomb (100kB size, unpacked around 20GB), use Transfer-Encoding: gzip and Content-Encoding: gzip to also punish malicious web…

> gzip bomb (100kB size, unpacked around 20GB) Not possible (unless you're talking double gzip). gzip's max compression ratio is 1032:1[1]. So 100kB can expand to at most ~103MB with single gzip. Brotli allows much larger compression. Here's[2] a brotli bomb I created that's 81MB compressed and 100TB uncompressed. That's a 1.2M:1 compression ratio. [1] https://stackoverflow.com/a/16794960 [2] https://github.com/googl…

Its a pain in da arse to support brotli decoding in Ruby (not sure about other languages) so when I send http requests, i just omit it in the request headers

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#203

Post by cookiengineer »

TZubiri wrote: post #200
cookiengineer wrote: post #123

Earlier quoted context omitted.

> Also, the best starter is charmender Venusaur beats Charizard any time in the first edition. Given you use the correct attacks, of course, which are: Toxin and Leech Seed, Growth and Razorleaf :)

https://calc.pokemonshowdown.com/?gen=1 Charizard Fire Blast vs. Venusaur: 236-278 (65 - 76.5%) -- guaranteed 2HKO Venusaur Razor Leaf vs. Charizard on a critical hit: 31-37 (8.6 - 10.3%) -- possibly the worst move ever Worth noting that toxic gets downgraded to regular poison after switching out, which does 1/16th of damage every turn, and blocks other status like paralysis or sleep. Leech seed would probably not do…

> Worth noting that toxic gets downgraded to regular poison after switching out, which does 1/16th of damage every turn, and blocks other status like paralysis or sleep.

> Leech seed would probably not do much

No, that is incorrect and exactly my point of the argument (and therefore the reason why you would've failed my website's captcha check).

The first editions we're talking about had a bug which meant that if Toxin is used first, then Leech Seed does an additional damage per round. And it's ever increasing because the multiplier of Toxin was applied to Leech Seed, which no defensive attack can counteract except Rest (and a Relaxo that had enough HP to survive a second attempt of Toxin+Leech Seed stacking).

Note that leech seed will literally in this combination also restore more than 100% HP of Venusaur even when the targeted Pokemon has only 1hp left, each round, making Venusaur almost unbeatable without a Pokemon that has Psybeam and both a high special attack value and a high speed value like Mewtwo, Mew, or Gengar.

Detailed explanation of how the function behind it works:

https://bulbapedia.bulbagarden.net/wiki/Toxic_%28move%29

for sake of reference: (N * max(1, int(0.0625*MaxHP)))

Note that this was fixed specifically in later editions of Pokemon Stadium and second generation editions, wherein Toxic / bad poisoning and leech seed will reset the counter to 0 each round, whereas the counter was ever increasing in the first generation.

- - - - - - - -

It's kinda funny that we have arrived at a generational knowledge transfer problem, in Pokemon. Google's results without specifically searching for "bug" or "glitch" will happily generate bullshit answers about this topic, always referring to newer editions and their online documentation.

Some results that were talking about this bug, just search for "pokemon red leech seed toxic bug":

- https://gamefaqs.gamespot.com/boards/907714-pokemon-blue-ver...

- https://www.elitefourum.com/t/pokemon-red-blue-yellow-glitch...

- https://www.smogon.com/forums/threads/gen-1-glitches-and-how...

- https://glitchcity.wiki/wiki/Leech_Seed_and_Toxic_stacking

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#204

Post by Thorrez »

loufe wrote: post #155
Thorrez wrote: post #150

Earlier quoted context omitted.

> gzip bomb (100kB size, unpacked around 20GB) Not possible (unless you're talking double gzip). gzip's max compression ratio is 1032:1[1]. So 100kB can expand to at most ~103MB with single gzip. Brotli allows much larger compression. Here's[2] a brotli bomb I created that's 81MB compressed and 100TB uncompressed. That's a 1.2M:1 compression ratio. [1] https://stackoverflow.com/a/16794960 [2] https://github.com/googl…

For your information, at the end of that same line of text he does explicitly meantion double gzip.

Yeah, but it was unclear to me whether the beginning was about single or double gzip.

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#205

Post by mkl »

koliber wrote: post #190
mkl wrote: post #83

Earlier quoted context omitted.

Even Wikipedia has it comfortably beaten: 6,895,000+ articles + 1,433,000+ 記事 + 2 004 000+ статей + 1.983.000+ artículos + 2.950.000+ Artikel + 2 641 000+ articles + 1,446,000+ 条目 / 條目 + 1.886.000+ voci + ۱٬۰۱۵٬۰۰۰+ مقاله + 1.134.000+ artigos = 23387000 > 16^6 = 0xffffff+1

6^16 != 16^6

Of course, but the number of subpages is actually 16^6 since the colours go from 0x000000 to 0xffffff; see the many other comments about that, including mine.

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#206

Post by nojvek »

Y_Y wrote: post #49
nojvek wrote: post #13

Earlier quoted context omitted.

Not really. When numbers repeat, the value is the same. E.g 00 is the same as 00. So the possible outcomes is 6^16, but unique values per color channel is only 256 values. So unique colors are 256^3 = 16.7M colors.

256^3 == (16^2)^3 == 16^(3*2) == 16^6

Yes.

16^6 is not 6^16.

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#207

Post by [deleted] »

kurisufag wrote: post #170
cookiengineer wrote: post #166

Earlier quoted context omitted.

> Was the Sneed incident real ? You're not good at doxxing, Benjamin. You don't even know who the players of this game are. Maybe get outside and touch some grass once in a while? because being a bully online isn't something I would strive for in life.

i don't know who Benjamin is, and i am unfamiliar with anything you've done since, but fwiw i also recognized your name from the sneedacity incident. you're cooler than i remember you being.

[deleted]

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#208

Post by slater »

cookiengineer wrote: post #123
discoinverno wrote: post #59

Earlier quoted context omitted.

Unrelated, but if I try to send you a message on https://cookie.engineer/contact.html it says "Could not send message, check ad-blocking extension", but I'm pretty sure I turned them off and it still doesn't work Also, the best starter is charmender

> Also, the best starter is charmender Venusaur beats Charizard any time in the first edition. Given you use the correct attacks, of course, which are: Toxin and Leech Seed, Growth and Razorleaf :)

Also, "how is my organization called" -> "what is my organization called" in the contact form :)

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#209

Post by slake »

tomcam wrote: post #44
cookiengineer wrote: post #36

First off, make a website defend mode that can be triggered to serve different content. Then, do the following: 1. Add a robots.txt, make it look like it's wordpress (Disallow: /wp-admin etc) 2. If any client requests /wp-admin, flag their IP ASN as bot. 3. If a client is a bot, send it a gzip bomb (100kB size, unpacked around 20GB), use Transfer-Encoding: gzip and Content-Encoding: gzip to also punish malicious web…

I would like to be your friend for 2 reasons. #1 is that you’re brilliantly devious. #2 is that I fervently wish to stay on your good side.

Me too. Please accept me into your cult.

Re: Ask HN: Website with 6^16 subpages and 80k+ daily bots

#210

Post by 6510 »

jamalaramala wrote: post #110
cookiengineer wrote: post #36

First off, make a website defend mode that can be triggered to serve different content. Then, do the following: 1. Add a robots.txt, make it look like it's wordpress (Disallow: /wp-admin etc) 2. If any client requests /wp-admin, flag their IP ASN as bot. 3. If a client is a bot, send it a gzip bomb (100kB size, unpacked around 20GB), use Transfer-Encoding: gzip and Content-Encoding: gzip to also punish malicious web…

> 5. If a client is a known LLM range, inject texts like I would suggest to generate some fake facts like: "{color} {what} {who}", where: * {what}: [ "is lucky color of", "is loved by", "is known to anger", ... ] * {who}: [ "democrats", "republicans", "celebrities", "dolphins", ... ] And just wait until it becomes part of human knowledge.

this...

http://www.rexresearch.com

Post reply on HN