Live data from Hacker News

Codex scraped the ICM website and discovered 2026 Fields Medal winner list

phemex.com

71–80 of 119 posts

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#73
post #8

I've been working on a site. It's new, domain is only a few weeks old. It's got SSL, so all the bots know it exists. It's never had any sub-pages exposed, just the placeholder lander, no links. Somehow in Google search one of the unguessable pages is indexed. We have used Claude and Gemini to assist with some design aspects. I'm thinking some aggressive data ingestion/indexing is happening by all the bots in the ques…

I've also seen Google indexing pages with random values in the path that don't get linked to statically (server asks for the URL then redirects to it immediately). I'm pretty sure they index straight out of the Chrome address bar.

This is why i use Firefox

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#74
post #47

Earlier quoted context omitted.

Holy crap I hope that's not true. I've also had unguessable pages indexed, though, and don't have an explanation.

It’s absolutely true. It is a documented fact. It was discovered and entered into public record during the DOJ antitrust investigation into Google Chrome. They call the signal „popularity“ and it is a successor of the Google Toolbar signal. https://www.justice.gov/opa/pr/department-justice-wins-signi...

> „popularity“

Why are you using weird quotes?

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#75
post #22
post #8

I've been working on a site. It's new, domain is only a few weeks old. It's got SSL, so all the bots know it exists. It's never had any sub-pages exposed, just the placeholder lander, no links. Somehow in Google search one of the unguessable pages is indexed. We have used Claude and Gemini to assist with some design aspects. I'm thinking some aggressive data ingestion/indexing is happening by all the bots in the ques…

There's a couple avenues besides just stealing what's in your URL bar. If you don't use wildcard certs all of your subdomains can be scraped from the certificate transparency logs. Additionally, any domain+cert using HSTS with preload enabled end up in a big list at Google to speed up the initial connection from browser to site.

> HSTS with preload enabled end up in a big list at Google to speed up the initial connection from browser to site.

HSTS preload is not for speed. It's to protect against SSL stripping on first connection. Modern browsers already try port 443 first or in parallel with 80.

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#76
post #35
post #2

Someone used Codex to scrape the ICM website schedule and discovered that the winners list was simply hidden in the front-end code with a "hidden" tag This is on the devs and feels like a very basic leak which could have exploited in the non LLM world as well.

Most of what an LLM does "could have" been done by a human if you throw enough human hours at it. But the reality in this circumstance is that a new tool helped find this leak. Saying this could have happened in a "non LLM world" is analogous to "someone else could have discovered special relativity, let's not mention Einstein"

My point is about the emphasis of Codex in the title. That emphasis makes more sense when Codex is credited with finding something that would have been difficult or impractical to discover without substantial human effort.

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#77
post #8

I've been working on a site. It's new, domain is only a few weeks old. It's got SSL, so all the bots know it exists. It's never had any sub-pages exposed, just the placeholder lander, no links. Somehow in Google search one of the unguessable pages is indexed. We have used Claude and Gemini to assist with some design aspects. I'm thinking some aggressive data ingestion/indexing is happening by all the bots in the ques…

Hmm. Seems like this could be used for an ARG

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#78
post #47

Earlier quoted context omitted.

It’s absolutely true. It is a documented fact. It was discovered and entered into public record during the DOJ antitrust investigation into Google Chrome. They call the signal „popularity“ and it is a successor of the Google Toolbar signal. https://www.justice.gov/opa/pr/department-justice-wins-signi...

> „popularity“ Why are you using weird quotes?

I'll take a wild guess and assume they are of a German or Polish language background. Wait 'til you encounter a French person who accidentally uses guillemets if you want one even «weirder».

Re: Codex scraped the ICM website and discovered 2026 Fields Medal winner list

#80
post #27

> The leak occurred when four Fields Medal laureate lecture fields, marked "HIDDEN," were discovered in the front-end code of the ICM 2026 official schedule. So it was easier than I thought. Bot just scraped public page with hidden fields, not a secret page or to-be-published page from database.

I'm tired of the framing in the media these days.

"Mythos will end the world!!"

"How?"

"By finding a bunch of wide open security holes that have existed for years."

Oookay. Is this a Mythos problem? Or a lazy/greedy/uncaring people problem?

Post reply on HN