Live data from Hacker News

“Magic links” can end up in Bing search results, rendering them useless

medium.com

81–90 of 243 posts

Re: “Magic links” can end up in Bing search results, rendering them useless

#81
post #80

Microsoft does this because they're security scanning / checking all links in every Outlook email for known phishing and malware attacks. If Bing has not seen the web page before and it's not in the Bing dangerous web page index it first needs to check it to make a determination of if it's a phishing/malware page by scanning/indexing it before returning that outcome back to Outlook to flag the email as dangerous.

Wouldn't it be trivial to keep the list of malicious pages locally and not send any data?

If I were designing a system like this, I would not trust clients to perform legitimate analysis nor report legitimate results.

Re: “Magic links” can end up in Bing search results, rendering them useless

#82
post #31

Can this be exploited to confirm some action automatically? Or to prevent some site from being indexed by flooding it with invalid links?

This becomes the interesting piece. What can you do with this known side effect..

Re: “Magic links” can end up in Bing search results, rendering them useless

#83
post #59

Okay, I thought M$ was just a little bit better than $G. It turned to be as bad...

Why would you think that? If M$ had the same position as google even more things would be closed source and more connected with law enforcement and less private.

Re: “Magic links” can end up in Bing search results, rendering them useless

#85

Earlier quoted context omitted.

But that is your calendar, not something that is normally speaking visible to the whole web.

It's not "your" calendar, it's Google's calendar.

By that logic they are not your emails, they are Google's.

Re: “Magic links” can end up in Bing search results, rendering them useless

#86
post #8

Earlier quoted context omitted.

I found them in Bing results

Are the URLs being served with a “noindex” header? Blocking crawls with robots.txt cannot de-list items from Google or other search engines. > Warning: Don't use a robots.txt file as a means to hide your web pages from Google search results. If other pages point to your page with descriptive text, Google could still index the URL without visiting the page. If you want to block your page from search results, use anoth…

> Warning: Don't use a robots.txt file as a means to hide your web pages from Google search results.

I realize that you are just the messenger and not the progenitor of that policy, so not addressing this to you, but: that is ridiculous. robots.txt is basically useless.

Re: “Magic links” can end up in Bing search results, rendering them useless

#87

Earlier quoted context omitted.

But that is your calendar, not something that is normally speaking visible to the whole web.

It's not "your" calendar, it's Google's calendar.

You know perfectly well what I meant.

Re: “Magic links” can end up in Bing search results, rendering them useless

#88

Microsoft does this because they're security scanning / checking all links in every Outlook email for known phishing and malware attacks. If Bing has not seen the web page before and it's not in the Bing dangerous web page index it first needs to check it to make a determination of if it's a phishing/malware page by scanning/indexing it before returning that outcome back to Outlook to flag the email as dangerous.

No post body was provided.

Re: “Magic links” can end up in Bing search results, rendering them useless

#89
post #39
post #5

>As of Feb 2017 Outlook ( https://outlook.live.com/ ) scans emails Makes me curious if only the free, online, Outlook does this. There's also paid O365 online Outlook and the fat client Outlook.

Office 365 just seems to make links useless for security now. Our 365 instance now turns every link into this massive monolith of safelink checking URLs through Microsoft, making literally every email undeterminable if it is a phishing attempt or otherwise without turning to pasting it into one of many online 'decoders'...

At work they enabled safelinks whilst all the mandatory training stated best practice was to check the links before clicking.

Its a shame those links can't have an alttext to show the real link.

Re: “Magic links” can end up in Bing search results, rendering them useless

#90

Isn't the quick fix that you arrive at some page, and there have to press a button or load some JS to do some action? AFAIK most email providers (like Gmail) will also visit links. Therefore you shouldn't do actions directly on the GET request. For instance if you have an unsubscribe link and all you have to do is visit that address, most of your subscribers will be accidentally unsubscribed. Same if you paste a link…

Yup this is true - I was just being lazy. But what surprised me was that Bing actually indexed them. (even though my robots.txt said not to)

> was that Bing actually indexed them. (even though my robots.txt said not to)

Never mind indexing them (ie publishing them at Bing.com), if URLs are disallowed in robots.txt then Bing shouldn't even be retrieving them, even if only to scan the content for malware!

Post reply on HN