Live data from Hacker News

Google de-indexed Bear Blog and I don't know why

journal.james-zhan.com

91–100 of 199 posts

Re: Google de-indexed Bear Blog and I don't know why

#91

Google search results have gone shit. I am facing some deindexing issues where Google is citing a content duplicate and picking a canonical URL itself, despite no similar content. Just the open is similar, but the intent is totally different, and so is the focus keyword. Not facing this issue in Bing and other search engines.

Yeah, Google search results are almost useless. How could they have neglected their core competence so badly?

Their core competency is ADs, not search.

Re: Google de-indexed Bear Blog and I don't know why

#92
post #83

I noticed google not being able to find smaller blogs a few years ago. The sort of blogs I used to like and read a lot - small irregular blog of an expert in something like cryptography, sociology etc kind of disappeared from the search. Then they disappeared for real. Even when I knew the exact name of article I was looking for google was unable to find it. And yes it still existed,

I have noticed the same thing. And the blogs are still there, I checked, and marginalia returns them as top results when I search the relevant keywords. Google just really doesn't care.

Re: Google de-indexed Bear Blog and I don't know why

#93

Earlier quoted context omitted.

Sorry but how did 2 work before you fixed it? You saved the queries people did and displayed them?

So the spammer would link to my search page with their query param: example.com/search?q=text+scam.com+text On my website, I'll display "text scam.com text - search result" now google will see that link in my h1 tag and page title and say i am probably promoting scams. Also, the reason this appeared suddenly is because I added support for unicode in search. Before that, the page would fail if you added unicode. So th…

Great blog post. You typically think of people linking to your website as a good thing. This is a good counterexample.

Re: Google de-indexed Bear Blog and I don't know why

#94

Traffic to my blog plummeted this year and you can never be entirely sure how it happened. But here are two culprits i identified. 1. Ai overview: my page impressions were high, my ranking was high, but click through took a dive. People read the generated text and move along without ever clicking. 2. You are now a spammer. Around August, traffic took a second plunge. In my logs, I noticed these weird queries in my se…

> my page impressions were high, my ranking was high, but click through took a dive. People read the generated text and move along without ever clicking.

This been our experience with out content-driven marketing pages in 2025. SERP results constant, but clicks down 90%.

This not good for our marketing efforts, and terrible for ad-supported public websites, but I also don't understand how Google is not terribly impacted by the zero-click Internet. If content clicks are down 90%, aren't ad clicks down by a similar number?

Re: Google de-indexed Bear Blog and I don't know why

#95
post #81

About six months ago Ahrefs recommended I remove some Unicode from the pathing on a personal project. Easy enough. Change the routing, set up permanent redirects for the old paths to the new paths. I used to work for an SEO firm, I have a decent idea of best practices for this sort of thing. BAM, I went from thousands of indexed pages to about 100 See screenshot: https://x.com/donatj/status/1937600287826460852 It's b…

They already scouted all content they needed. Sites are now competition for their AI systems

Re: Google de-indexed Bear Blog and I don't know why

#96
post #28

Earlier quoted context omitted.

That literally already exists and nobody uses it. Gnutella. Jabber. Tor. IPFS. Mastodon. The Entire Fucking IPv4/IPv6 Address Space And Every Layer Built On Top Of It. (if you don't think the internet is p2p, you don't understand how it works) You know what else we need? We need food to be free. We need medicine to be free, especially medicines which end epidemics and transmissible disease. We need education to be fr…

I do not think free is attainable for everything due to thermodynamics constraints. Imagine "free energy". Everybody uses as much as they want, Earth heats up, things go bad (not far from what is actually happening!). I would settle for simpler, attainable things. Equal opportunity for next generation. Quality education for everybody. Focus on merit not other characteristics. Personal freedom if it does not infringe…

> Equal opportunity for next generation.

What does this mean? I suppose it can't literally mean equal opportunity, because people aren't equal, and their circumstances aren't equal; but then, what does this mean?

Re: Google de-indexed Bear Blog and I don't know why

#97

Google search results have gone shit. I am facing some deindexing issues where Google is citing a content duplicate and picking a canonical URL itself, despite no similar content. Just the open is similar, but the intent is totally different, and so is the focus keyword. Not facing this issue in Bing and other search engines.

Check that you're not routing unnamed SNI requests to your web content. If someone sets up a reverse proxy with a different domain name, google will index both domains and freak out when it sees duplicate content. Also make sure you're setting canonical tags properly. Edit: I'd also consider using full URLs in links rather than relative paths.

Re: Google de-indexed Bear Blog and I don't know why

#98
post #58

When I reload the page " https://journal.james-zhan.com/google-de-indexed-my-entire-b... ", I get Request URL: https://journal.james-zhan.com/google-de-indexed-my-entire-b... Request Method: GET Status Code: 304 Not Modified So maybe it's the status code? Shouldn't that page return a 200 ok? When I go to blog.james..., I first get a 301 moved permanently, and then journal.james... loads, but it returns a 304 not modi…

Has anyone noticed that the response for the blog page has a header: "x-robots-tag: noindex, nofollow"? What's the purpose of this header on a content page?

UPD: Sorry, never mind, I inspected a wrong response.

Re: Google de-indexed Bear Blog and I don't know why

#99
post #50

Earlier quoted context omitted.

Interesting - surely you'd have to trick Google into visiting the /search? url in order to get it indexed? I wonder if them listing all these URLs somewhere are requesting that page be crawled is enough. Since these are very low quality results surely one of Google's 10000 engineers can tweak this away.

> surely you'd have to trick Google into visiting the /search? url in order to get it indexed That's trivially easy. Imagine a spammer creating some random page which links to your website with that made up query parameter. Once Google indexes their page and sees the link to your page, Google's search console complains to you as the victim that this page doesn't exist. You as in the victim have no insight into where…

I messed around with our website trying url encoded hyperlinks etc but it was all escaped pretty well. I bet there's a lot of tricks out there for those with time on their hands. Why anyone would bother creating content when Google AI summary is effectively going to steal it to intercept your click is beyond me. So the whole issue will solve it's self when google has nothing to index except endless regurgitated slop and everyone finally logs off and goes outside.

Re: Google de-indexed Bear Blog and I don't know why

#100
post #96
post #28

Earlier quoted context omitted.

I do not think free is attainable for everything due to thermodynamics constraints. Imagine "free energy". Everybody uses as much as they want, Earth heats up, things go bad (not far from what is actually happening!). I would settle for simpler, attainable things. Equal opportunity for next generation. Quality education for everybody. Focus on merit not other characteristics. Personal freedom if it does not infringe…

> Equal opportunity for next generation. What does this mean? I suppose it can't literally mean equal opportunity, because people aren't equal, and their circumstances aren't equal; but then, what does this mean?

A clear definition is definitively hard to come by, but I will share what I see as rather large issues that impact society: minimal spending per children for education to allow a good service for most (this will imply that smart kids are selected and become productive as opposed to drop out because they had nobody to learn from); reasonable health availability for children such that they can develop rather than being sick; sufficient food for children to support the first two (can't learn or be healthy if you are hungry).

Currently I know in many countries multiple measures/rules/policies that affect these 3 things in ways that I find damaging for the society overall on the long term. Companies complain they don't have work forces, governments complain the natality is low but there are many issues with raising a child. Financial incentives to parents do not seem to work (for example: https://www.bbc.com/news/world-europe-47192612)

Post reply on HN