something about this search is a winner for me, it's killed it for a few terms I've thrown in like "applicative languages" and "low level"
The Evolution of Marginalia's Crawling
21–25 of 25 posts
Re: The Evolution of Marginalia's Crawling
#22Kinda wish there was more software architecture discussions. It's hard to get right, and has a huge effect on what you're able to do with your software, but it feels like many of us (myself very much included) are just sort of winging it as we go along based on fads, hunches and whatever random assortment of experiences we've had professionally, which can't be very many bigger projects no matter who you are or how lo…
I feel like there are already more software architecture discussions out there than can be read by a single person. they're just not indexed well ;)
Re: The Evolution of Marginalia's Crawling
#23No post body was provided.
Re: The Evolution of Marginalia's Crawling
#24[dead]
Re: The Evolution of Marginalia's Crawling
#25Earlier quoted context omitted.
I'm beginning to think that there's no right answer, because the ideal crawling rules depend a lot on what type on content you're seeking, which obviously can't be known up front. I'm working on a federated search tool. I've built a few different sectors (I've called them "realms") that I care about (programming, automotive, racing, fediverse) and found that I need pretty different heuristics depending. Example: car…
Yeah, probably. Could also be the answer isn't more complicated than to offer up the ability to control the search a bit more. Especially with forums it's easy to figure out the post time since there's only some half-dozen forum softwares. Maybe just add the option to filter by year or something would go a long way. I do think offering different filters like that is probably a good option to having the search engine…
Yea, I don't think the idea has any real value. It kind of falls in between a bookmarking tool and a search engine. But forming search engines from trees of other search engines is kind of cool, and I have stumbled onto knowledge that I wouldn't have otherwise found. I'm not sure what the balance is between mind reading and offering too many knobs to a user is, though.