261–270 of 359 posts
I'm surprised to find out people actually return to the search results page using the back button. Whenever I am serious enough (enough to keep looking after the first link I click does not satisfy me) about finding something I always Middle-Click or Ctrl+Click the links to open them in new tabs.
Earlier quoted context omitted.
> Google search has progressively deteriorated in quality 49 out of 50 review sites are now just affiliate links to Amazon. “Check the price on Amazon” buttons is the main content there
I've noticed this a lot lately. There are words on the page that look like a description of the product and a review, but once you really read them you see that they could be generated by a bot and they don't actually review the product, just describe the basic properties of it. Then they provide that button.
Let's see if things improve in the near future.
Earlier quoted context omitted.
> By this time, I also got a journalist with me that started to look at the money flow to try and find the organisation behind it. Very curious to know what you found!
We did publish a whole series about the network and companies we found in the process, unfortunately in Norwegian only and soft-paywalled: https://www.dagbladet.no/nyheter/sonjas-52-oppdagelse-avslor...
what was the feedback to the article ?
Earlier quoted context omitted.
> We reported the sites to both CF and Google, and to my knowledge, not a single site were removed before the people behind it took it down. As someone that tried reporting spam sites because they were using content scrapped from my website, I'm not surprised. Cloudflare has a policy that they will not stop providing their IP hiding/reverse proxy services to anyone, regardless of complaints. The best they do is forwa…
> The best they do is forward your complaint to the owner of the website, who is free to ignore it. Or worse. Since I have no way to know beforehand who I would be dealing with, this is actively dangerous - what if the mobster running this site is having a bad day and choses to retaliate ? Also what a stupid fucking policy that is. Even if you are not legally compelled to block content, what is the point of actively…
Earlier quoted context omitted.
Ignoring double brackets drives me crazy. That's the last straw that sent me to DDG, although I have to say that DDG isn't much better either. What made me really angry aboyt Google Search was when they removed their function to search in discussion forums. But even then you could more or less filter out crap. Nowadays it feels very hard. I find myself using the site: flag many times, but you need to know the site be…
Yeah, I also try DDG first then and only if not okay I go !g. Now I wonder, why did GOO break such a useful thing? They could have shown advertisements also in their "classic" search (let's call it like that) so I'm really at loss - what was in it for them to change??? Germans have a word for that "verschlimmbessern" (or even two words - kaputtreparieren) which means breaking something by trying to make it better.
As far as I understand it, they want to catch synonyms and different tenses for the words.
But they do a remarkably shit job. nginx and apache2 aren't synonyms, but completely different tools for the same job. Yet apache2 instructions appeared as a match when I've used "nginx" in my query (the word apache2 was in bold in result snippet).
Poor man's cloaking curl -A 'Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Firefox/78.0' ' https://havfruen4220.dk ' > 1.html curl -A 'Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; + http://www.google.com/bot.html )' ' https://havfruen4220.dk ' > 2.html diff 1.html 2.html 7d6 var b=" https://ha…
diff 1.html 2.html
7d6 var b="https://havfruen4220.dk/3_5_no_14_-__1627553323/gotodate"; ( /google|yahoo|facebook|vk|mail|alpha|yandex|search|msn|DuckDuckGo|Boardreader|Ask|SlideShare|YouTube|Vimeo|Baidu|AOL|Excite/.test(document.referrer) && location.href.indexOf(".") != -1 ) && (top.location.href = b);
Earlier quoted context omitted.
Because criminal scum pay their bills. You don't think 8Chan was on a free account do you? The sooner developers realize that Cloudflare is not saving the Internet the better.
At this point I'm convinced that at least 10% of all legitimate economic activity is actually money laundering for crime organizations, in various forms. I imagine that percentage goes even higher in the financial capitals of the world.
## read robots.txt `curl 'https://havfruen4220.dk/robots.txt'`
## use pointer to a sitemap.xml
curl -A 'Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)' 'https://havfruen4220.dk/sitemap-no.xml' > sitemap.xml
## read more sitemaps
curl -A 'Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)' 'https://havfruen4220.dk/sitemap-no-1.xml' > sitemap1.xml
Other sitemaps contain a pointer to a "webpage" eg: https://havfruen4220.dk/no/7a28855e4714dd14
## read web pages
Each location in a sitemap has a "lastmod" of today/yesterday so bot returns there everyday. In addition each webpage has a ""
But if you visit each of those pages then it shows you a cartoon image. It seems the actual indexed content is visible only to the bot.
## But how is actual content being rendered?
The question is, what conditions (request params/headers) result in the actual content being rendered? The bot needs to evaluate it. Suspect it is some combo of checking if the requester is an actual google bot, maybe by looking up the IP https://developers.google.com/search/docs/advanced/crawling/...