Live data from Hacker News

Ask HN: Why does Pinterest dominate Google text search results?

news.ycombinator.com

91–100 of 329 posts

Re: Ask HN: Why does Pinterest dominate Google text search results?

#91

I do not know whether Google gives Pinterest preferential treatment. That said, I'd like to know: What are you searching? Results will be different depending on if you're searching "cute bedroom ideas" or "epistemology in pre-Socratic Greece."

"epistemology in pre-Socratic Greece." has a few results from Pinterest.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#92

Earlier quoted context omitted.

> since no one other than Google is really allowed to crawl the web. ??

There are two main reasons why I say nobody besides Google is really allowed to crawl the web. The first is that Google gets much more access to pages on websites than everybody else. You can see this by examining the robots.txt files of various websites[0]. I've been doing this for several years now and Google has a consistent advantage across many thousands websites that I've looked at. This adds up to a significan…

So, uh, don't respect robots.txt in your search engine? It's not like there's a law that you have to, and that you can't pretend you are Googlebot. The only real obstacle I can imagine is that some firewalls might be configured to be more permissive with traffic originating from Google subnets.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#93
post #54
post #47

Earlier quoted context omitted.

Stop using Google search. DDG works just as well

I use DDG search most of the time, but I find this to be untrue. DDG is pretty good, but struggles with context a lot more than Google does. For example, when searching for an error in a programming library, DDG is likely to return the library homepage, whereas google is more likely to return the specific github issue where the error is being discussed.

Agreed. I switched to DDG a few weeks ago as a default. I appreciate the privacy, but for some categories (like tech questions) the results are just... not as accurate. For general queries they're comparable. For searching specific issues, Google is more likely to show relevant discussion threads of the exact issue.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#94
post #35
post #17

Earlier quoted context omitted.

Just do -pinterest in your search to filter

Or just avoid using google. The Pinterest results in google image search queries was a major driver to me using bing/ duck duck go.

Linking directly to the image file (and in fact a cached version of the full image) is one of the best reasons to use DDG.

Reverse image search is also intentionally gimped, unlike non-US jurisdiction Yandex which is quite good.

It's certainly for legal reasons, not technical, but Image Search has gotten progressively worse every year. It used to be godly effective 10 years ago.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#95
post #92

Earlier quoted context omitted.

There are two main reasons why I say nobody besides Google is really allowed to crawl the web. The first is that Google gets much more access to pages on websites than everybody else. You can see this by examining the robots.txt files of various websites[0]. I've been doing this for several years now and Google has a consistent advantage across many thousands websites that I've looked at. This adds up to a significan…

So, uh, don't respect robots.txt in your search engine? It's not like there's a law that you have to, and that you can't pretend you are Googlebot. The only real obstacle I can imagine is that some firewalls might be configured to be more permissive with traffic originating from Google subnets.

You would be blocked fairly quickly by many website operators and no longer able to access those websites if you straight up ignored robots.txt files. You also might even end up being served cease and desists by some websites and sued if you continue to persist and try to find ways around it.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#96

Earlier quoted context omitted.

User: This service has a problem and it's not working well. Programmer: There's nothing wrong with the service, you just have to use [magic incantation] to make it work right. I've been hoping for 20 years that this kind of exchange would stop happening. Still hoping! :-)

Services and users have different goals. Why is the helpful technologist the problem?

Your second statement is enabling bad behavior, your first statement is insane.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#97
post #17
post #13

Earlier quoted context omitted.

Google should be asking from a product perspective if they are providing the search results the user is most likely seeking. I seriously doubt that most pinterest results are what users are seeking. As such, Google probably should consider changes to their algorithm to compensate (cat and mouse) for pinterest's gaming. That is assuming how pinterest does it is not against any google rules... because if it were agains…

Just do -pinterest in your search to filter

It would be great if Google had a little "hide this domain for me permanently" next to every search result. Not only would it improve that user's own search results, it's a very strong signal that other users also might not like it, for de-ranking purposes.

Re: Ask HN: Why does Pinterest dominate Google text search results?

#98
post #84

Related: in the last several years, there started appearing these StackOverflow mirrors. It's gotten to the point that you can't google a programming question without running into at least one. Some copy the questions and answers verbatim, some use machine translation to (crappily) translate them into my native language. Sometimes they even rank higher than the real StackOverflow. I really wish there was a non-hacky…

They're pretty old. I remember when Google added an option to block domains (the option you want) around 2011 and they were the first thing I removed from my results, along with Wikipedia mirrors.

After the option to block domains was removed around 2014-2015, I rarely came across those anymore, but it seems they're back...

Re: Ask HN: Why does Pinterest dominate Google text search results?

#100
post #84

Related: in the last several years, there started appearing these StackOverflow mirrors. It's gotten to the point that you can't google a programming question without running into at least one. Some copy the questions and answers verbatim, some use machine translation to (crappily) translate them into my native language. Sometimes they even rank higher than the real StackOverflow. I really wish there was a non-hacky…

I've even had one of those spammy websites appear as the first result, in a "featured" box. It's just sad. https://news.ycombinator.com/item?id=25437378
Post reply on HN