As a 501(c)(3) nonprofit that is not dependent on web traffic for revenue, is a decline in traffic necessarily bad? I always assumed the need for metastatic growth was limited to VC-backed and ad-revenue dependent companies.
They are highly dependent on web traffic for revenue. And their costs are even increasing because while human viewers are decreasing they are getting hugged to death by AI scrapes.
For such purposes, I'd naively just setup some weekly job to download Wikipedia and then run a "scrape" on that. Even weekly may be overkill; a monthly snapshot may do more than enough.