Live data from Hacker News

Gmail is opening and caching URLs within emails without user intervention (2019)

support.google.com

61–70 of 271 posts

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#61
post #25

Earlier quoted context omitted.

Make the user take action after opening the link. Like click a button.

And make sure the action is a POST instead of a GET. GETs should never modify important state.

Email should never rely on HTML forms that can POST.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#63
post #3

I built a small Go web app to do some security testing. When a user registers for an account, I generate a 128-bit secure token and email it to the address they provided (as a URL). Token URLs look like this: /validate/email/1d00a5c2648c211befd33f5a8a7cbfab The token is cryptographically strong and disappears after access. It can't be guessed and no one but the email account holder should click it, but I am seeing th…

I'm sure Google uses a specific user agent to make a request, so you can filter that out.

A better solution is to assume that some middleman (email server or client) will always try to access links in the email. Instead send the user a code and have them manually enter it on the linked page.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#64

I always wondered when single-click unsubscribe was going to be a problem because of exactly this. I mean, how do you expect to give a URL to Google and have them just never crawl it?

> I always wondered when single-click unsubscribe was going to be a problem

To put succinctly what others are saying: it was never not a problem; it never should have been happening.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#65
post #3

I built a small Go web app to do some security testing. When a user registers for an account, I generate a 128-bit secure token and email it to the address they provided (as a URL). Token URLs look like this: /validate/email/1d00a5c2648c211befd33f5a8a7cbfab The token is cryptographically strong and disappears after access. It can't be guessed and no one but the email account holder should click it, but I am seeing th…

I've had a lot of grief from a few users' Exchange doing it (likely as part of some anti phishing plugin of sorts), to the point we changed validation links from one time to sort lived.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#66

I always wondered when single-click unsubscribe was going to be a problem because of exactly this. I mean, how do you expect to give a URL to Google and have them just never crawl it?

There's also RFC 8058 [0] that proposes to refine the `List-Unsubscribe` header for one-click unsubscriptions. It uses the `List-Unsubscribe-Post` header to indicate that an HTTP POST request can be used to unsubscribe with a single click.

It specifically mentions in section 3.2 that mail receivers are not to crawl this URL without user consent:

> The mail receiver MUST NOT perform a POST on the HTTPS URI without user consent. When and how the user consent is obtained is not part of this specification.

I haven't seen any statistics on how widespread adoption of this RFC is among the major mail providers, though.

[0]: https://datatracker.ietf.org/doc/html/rfc8058

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#67
post #22

Earlier quoted context omitted.

Make the user take action after opening the link. Like click a button.

Thanks. That's good advice.

Btw you could just have JS do a POST request, the user doesn't need to do anything except open the page. This is how unsubscribe pages work.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#68
post #50
post #13

Earlier quoted context omitted.

True. Phish testing campaigns in companies that send fake phishing emails to employees, are probably full of inaccurate data due to this. "Why did you click that link? But, I didn't."

Many phishing test as a service companies will report clicks vs. people who actually interact with the page.

Which is more accurate since clicking a link is not usually an issue while filling out a form on it is the real attack.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#69

Earlier quoted context omitted.

But to be fair, 1-click unsubscribe is a very user friendly thing to do. As a user, if I have to jump through a bunch of hoops to unsubscribe, I'm just going to mark your message as spam and move on with my life.

Exactly. And it's not just one-click unsubscribe. Using a secret link sent to an account's email address as a way to implicitly log in instead of having to remember a password is increasingly common and also an interesting idea in terms of user experience and security. If it's OK for your mail service to open one secret link, where does it stop? Is it also OK for them to spider the content they can reach from that li…

> to open one secret link

"Secret link" is an oxymoronical concept. Resource identifiers are exactly that: identifiers. They're not private names, and any design that relies on keeping them secret is inherently flawed. If it's accessible on the openly resolvable web, then the content needs to be treated as if it's public. If your use calls for authentication or authorization, then actually use an authentication or authorization system.

Re: Gmail is opening and caching URLs within emails without user intervention (2019)

#70

Earlier quoted context omitted.

But to be fair, 1-click unsubscribe is a very user friendly thing to do. As a user, if I have to jump through a bunch of hoops to unsubscribe, I'm just going to mark your message as spam and move on with my life.

Exactly. And it's not just one-click unsubscribe. Using a secret link sent to an account's email address as a way to implicitly log in instead of having to remember a password is increasingly common and also an interesting idea in terms of user experience and security. If it's OK for your mail service to open one secret link, where does it stop? Is it also OK for them to spider the content they can reach from that li…

>>Using a secret link sent to an account's email address as a way to implicitly log in instead of having to remember a password is increasingly common and also an interesting idea in terms of user experience

The user experience with this is terrible if email is not set up on the device you want to log in from

Post reply on HN