Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google de-indexed Bear Blog and I don't know why

journal.james-zhan.com

Post reply on HN
Print view View original

101–110 of 199 posts

Re: Google de-indexed Bear Blog and I don't know why

#101

Post by weird-eye-issue »

dazc wrote: post #29
firefoxd wrote: post #22

Traffic to my blog plummeted this year and you can never be entirely sure how it happened. But here are two culprits i identified. 1. Ai overview: my page impressions were high, my ranking was high, but click through took a dive. People read the generated text and move along without ever clicking. 2. You are now a spammer. Around August, traffic took a second plunge. In my logs, I noticed these weird queries in my se…

Sounds like point 2 was a negative seo attack. It could be that your /?s page is being cached and getting picked up via crawlers. You can avaoid this by no caching search pages and applying noindex via X-robots tag https://developers.google.com/search/docs/crawling-indexing/...

Cache has nothing to do with this

But yes just noindex search pages like they already said they did

Re: Google de-indexed Bear Blog and I don't know why

#102

Post by morkalork »

torben-friis wrote: post #88
daemonologist wrote: post #12

Earlier quoted context omitted.

I've also noticed Google having indexing issues over the past ~year: Some popular models on Hugging Face never appear in the results, but the sub-pages (discussion, files, quants, etc.) do. Some Reddit pages show up only in their auto-translated form, and in a language Google has no reason to think I speak. (Maybe there's some deduplication to keep machine translations out of the results, but it's misfiring and disca…

Reddit auto translation is horrible. It’s an extremely frustrating feeling, starting to read something in your language believing it’s local, until you reach a weird phrase and realise it’s translated English. It’s also clearly confusing users, as you get replies in a random language, obviously made by people who read an auto translation and thought they were continuing the conversation in their native language.

I will google for something in French when I don't find the results I want in English. Sometimes google will return links to English threads (that I've already seen and decided were worthless!) auto-tranalated to French. As if that were any help at all..

Re: Google de-indexed Bear Blog and I don't know why

#103

Post by crazygringo »

azangru wrote: post #98
qwertox wrote: post #58

When I reload the page " https://journal.james-zhan.com/google-de-indexed-my-entire-b... ", I get Request URL: https://journal.james-zhan.com/google-de-indexed-my-entire-b... Request Method: GET Status Code: 304 Not Modified So maybe it's the status code? Shouldn't that page return a 200 ok? When I go to blog.james..., I first get a 301 moved permanently, and then journal.james... loads, but it returns a 304 not modi…

Has anyone noticed that the response for the blog page has a header: "x-robots-tag: noindex, nofollow"? What's the purpose of this header on a content page? UPD: Sorry, never mind, I inspected a wrong response.

I don't see it. With Chrome devtools, for the posted URL I see X-Clacks-Overhead, X-Content-Type-Options, and X-Frame-Options. No X-Robots-Rag.

And no in the HTML either.

What URL are you seeing that on? And what tool are you using to detect that?

Edit: cURL similarly shows no such header for me:

  curl -s -D - -o /dev/null https://journal.james-zhan.com/google-de-indexed-my-entire-bear-blog-and-i-dont-know-why/

Re: Google de-indexed Bear Blog and I don't know why

#105

Post by iamnothere »

watwut wrote: post #83

I noticed google not being able to find smaller blogs a few years ago. The sort of blogs I used to like and read a lot - small irregular blog of an expert in something like cryptography, sociology etc kind of disappeared from the search. Then they disappeared for real. Even when I knew the exact name of article I was looking for google was unable to find it. And yes it still existed,

Marginalia search is good for this. But generally it’s becoming a real problem due to Google’s dominance. Blog authors ought to look into web rings and crosslinks again to help each other out with discovery.

Re: Google de-indexed Bear Blog and I don't know why

#106

Post by azangru »

crazygringo wrote: post #103
azangru wrote: post #98

Earlier quoted context omitted.

Has anyone noticed that the response for the blog page has a header: "x-robots-tag: noindex, nofollow"? What's the purpose of this header on a content page? UPD: Sorry, never mind, I inspected a wrong response.

I don't see it. With Chrome devtools, for the posted URL I see X-Clacks-Overhead, X-Content-Type-Options, and X-Frame-Options. No X-Robots-Rag. And no in the HTML either. What URL are you seeing that on? And what tool are you using to detect that? Edit: cURL similarly shows no such header for me: curl -s -D - -o /dev/null https://journal.james-zhan.com/google-de-indexed-my-entire-bear-blog-and-i-dont-know-why/

Sorry. I am an idiot. Checked the wrong url. Please ignore.

Re: Google de-indexed Bear Blog and I don't know why

#108

Post by Goofy_Coyote »

firefoxd wrote: post #22

Traffic to my blog plummeted this year and you can never be entirely sure how it happened. But here are two culprits i identified. 1. Ai overview: my page impressions were high, my ranking was high, but click through took a dive. People read the generated text and move along without ever clicking. 2. You are now a spammer. Around August, traffic took a second plunge. In my logs, I noticed these weird queries in my se…

Question: If I do a search for say crypto on your blog, how does Google gets to index the resulting page?

I’m imagining something like “blog.example/?s=crypto” which only I should see, not Google.

Edit: Where they linking to your website from their own? (In that case the link with the bad search keywords can be crawled)

Re: Google de-indexed Bear Blog and I don't know why

#109

Post by dazc »

weird-eye-issue wrote: post #101
dazc wrote: post #29

Earlier quoted context omitted.

Sounds like point 2 was a negative seo attack. It could be that your /?s page is being cached and getting picked up via crawlers. You can avaoid this by no caching search pages and applying noindex via X-robots tag https://developers.google.com/search/docs/crawling-indexing/...

Cache has nothing to do with this But yes just noindex search pages like they already said they did

Not sure how search result pages can be crawled unless they are cached somewhere?

Re: Google de-indexed Bear Blog and I don't know why

#110

Post by dazc »

p410n3 wrote: post #78
dazc wrote: post #27

Breaking News: Google de-indexes random sites all of the time and there is often no obvious reason why. They also penalize sites in a way where pages are indexed but so deep-down that no one will ever find them. Again, there is often no obvious reason.

Do you have any resources here? The /r/seo subreddit seems vers superficial coming from an web agency background so its hard to find legit cases versus obvious oversights. Often people make a post describing a legit sounding issue on there just to let it shine through that they are essentially doing seo spam.

It's something you'll experience if you publish many sites over time. Can't point to any definitive sources, many of the reputable search related blogs are now just Google shills.
Post reply on HN