Live data from Hacker News

“Magic links” can end up in Bing search results, rendering them useless

medium.com

241–243 of 243 posts

Re: “Magic links” can end up in Bing search results, rendering them useless

#241
post #152

I've had to deal with this with e-mail verification links and Auth0. The user clicked the link after getting it in their mailbox but then Auth0 throws up an error page because the e-mail address has already been verified (by Outlook scanning). The problem becomes worse if for some reason the mail ends up in the junk mail folder so the user thinks they've never received the mail but when you check it looks like the e-…

I had a customer who had some sort of software that followed the link in the email we sent (no big deal so far), and THEN would follow every link and button on that page. We had a handy quick decline and accept button on there so they were auto declining things… I didn’t hate email until I got into web development….

Having decline or accept buttons may not be enough.

How about having a input field asking for the email again to double check?

Re: “Magic links” can end up in Bing search results, rendering them useless

#242
post #200
post #174

Earlier quoted context omitted.

If those pages have no proper meta tags or robots.txt, there’s absolutely nothing wrong with this. Security by obscurity was never a good approach; from Proxies to security scanners, there has always been software that crawls unassuming URLs and published the results somewhere, if only a report to the admin.

robots.txt disallow is ignored for my production site at least. This is super bad.

Same for us - we have robots.txt disallow etc. and the relevant headers for personal customer links and Bing is ignoring and publishing all the same

Re: “Magic links” can end up in Bing search results, rendering them useless

#243
post #92

Earlier quoted context omitted.

They are publishing them - it has bitten us (e.g. expired one click links for customers ending up on Bing from their emails)

I think this is where we use meta tags. All pages with one click links should have no index follow or no index no follow. Your seo consultant (if you have one) should have advised you on this. I am not saying this excuses the privacy violation but just suggesting there are things we can do...

Bing appears to be ignoring those headers for links crawled from emails
Post reply on HN