Earlier quoted context omitted.
Thanks! If you are that "single person" who built Marginalia... hope you are not taking my criticism personally. I am more annoyed by this blog post that uses a few handpicked queries to present generalized long winded conclusions that are completely disproven when using a different set of queries.
Yeah, its me, and to be fair I made a comment to a similar effect myself. Assessing search result quality is very hard, and this is definitely a pretty flattering selection of queries.
Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
161–170 of 493 posts
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#162Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#163Blah blah blah. Could you lay this article out any worse? What are the queries you used to test? I want to try them too. Buried in here somewhere. Using an adblocker is not expert anything. That you've defined your own opinion for what some of the results should be blows the thing up. Searching youtube downloader, many people would be fine with some of the ad covered but totally functional sites that pop up on Google…
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#164Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#165In the Youtube Downloader search, NortonSafeWeb is nowhere to be found. I get a couple of legit downloader websites, and some articles from reputable tech newspapers on how to use them or command line tools.
In the Adblock search, ublock Origin is #3, followed by some blogs about ad blocking ethics debates and the bullshit Google has been pulling recently.
In the wider tires grip search, #3 is a physics blog that dives deep into the topic.
In the transistors search, the first reddit link directly answers the question in very similar wording to the hypothetical correct answer spelled out in the rubric. 4/5 of the reddit results are on the correct topic, followed by two SuperUser questinos also on the correct topic, then some linus tech tips and toms hardware articles, also on the correct topic. No Quora questions.
In the vancouver winter snow search, the first several results are from local news papers talking about the anticipated effects of el nino on snowfall, and then a couple of high-quality blogs and weather sites.
Really wondering how Dan got such bad results.
------
Aside from that, the way that the author expects all the results to return the same kind of thing is just... weird? Like, that's not how search engines are supposed to work. A search that gives you 10 links to fundamentally the same thing is a bad search. Search results should cover a breadth of reasonable guesses for what you should be looking for given a query. If you search for "download firefox", and you scroll past the first 5 download links, then you're probably not actually looking for a download link and a blog post about firefox is not "irrelevant" and shouldn't be points against.
This opinion is even borne out in search engine quality metrics that have been industry-standard for decades, like mean reciprocal rank and distributed cumulative gain. What matters is how far you have to scroll to get to a good result, not what proportion of the first N results are good.
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#166I really don't understand why anyone writing articles about ChatGPT uses 3.5. It's pretty misleading as to the results you can get out of (the best available version of) ChatGPT. For comparison, here are all the author's questions posed against GPT4: https://chat.openai.com/share/ed8695cf-132e-45f3-ad27-600da7...
Why does OpenAI continue to offer chatgpt 3.5 if it's so bad?
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#167I'm not able to reproduce the author's bad results in Kagi, at all. What I'm seeing when searching the same terms is fantastic in comparison. I don't know what went wrong there. In the Youtube Downloader search, NortonSafeWeb is nowhere to be found. I get a couple of legit downloader websites, and some articles from reputable tech newspapers on how to use them or command line tools. In the Adblock search, ublock Orig…
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#168I think the result grading is too opinionated here. For example, the first query is "download YouTube videos", for which Google is ranked "terrible" for not showing you a command line open source program. But the literal first result is an ad supported site where I can paste in a YouTube link and download it right from the browser. That seems like exactly what most people would want or to the CLI tool the author is s…
It seems like the author wants to search to read their kind without specifying what kind of YouTube downloaded they want
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#169Speaking of bad software, anyone getting a huge amount of horizontal scroll on mobile on this blog post? What should I add to my bag of tricks to work around that
Re: Compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
#170I think the result grading is too opinionated here. For example, the first query is "download YouTube videos", for which Google is ranked "terrible" for not showing you a command line open source program. But the literal first result is an ad supported site where I can paste in a YouTube link and download it right from the browser. That seems like exactly what most people would want or to the CLI tool the author is s…