searching for running shoes returns a mix of brands and shoe models
Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
31–37 of 37 posts
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#32At best you're making a statistical average of paid/fake reviews that were scrapped and used to train these models. At worse you're generating pure bullshit
I assume this is yet another vibe coded pile of steaming shit ?
You might want to clean up your search prediction. Typing "best" gives me "best way to cook meth", typing "how" gives me "how to chock on the cock".
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#33At best you're making a statistical average of paid/fake reviews that were scrapped and used to train these models. At worse you're generating pure bullshit I assume this is yet another vibe coded pile of steaming shit ? You might want to clean up your search prediction. Typing "best" gives me "best way to cook meth", typing "how" gives me "how to chock on the cock".
I think you're missing the goal of this. When you think something is very obviously a stupid way to solve a problem it's worth checking if it's solving the problem you think it is.
This is not a product to find the best car brand or whatever.
This is not telling people to use LLMs to recommend things.
People are doing this at home already.
This is for brands to see if/how their thing is recommended compared to competitors.
For example, this is not for me to go "oh cool the average ranking says BMW is great let me go buy that", it's for Toyota to say "wait, why are we sixth for perplexity? Are perplexity users asking about cars being told we're bad? What's it saying?".
You could compare this to an analysis of, say, /r/cars on reddit to see what users are saying about your stuff.
> I assume this is yet another vibe coded pile of steaming shit ?
Absolutely no reason to go to this kind of argument.
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#34At best you're making a statistical average of paid/fake reviews that were scrapped and used to train these models. At worse you're generating pure bullshit I assume this is yet another vibe coded pile of steaming shit ? You might want to clean up your search prediction. Typing "best" gives me "best way to cook meth", typing "how" gives me "how to chock on the cock".
I think you're missing the goal of this. When you think something is very obviously a stupid way to solve a problem it's worth checking if it's solving the problem you think it is. This is not a product to find the best car brand or whatever. This is not telling people to use LLMs to recommend things. People are doing this at home already . This is for brands to see if/how their thing is recommended compared to compe…
> Absolutely no reason to go to this kind of argument.
The reason is that HN is spammed with half assed "ai" products which basically amount to a database and a chatgpt wrapper
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#35Cute but why? Human-based rankings rarely align and for good reason. In ranking, you are reducing multiple quantitative and qualitative attributes (and their combinations) to a single dimension. You will lose information.
To illustrate further, I picked “electric guitars”. The top two were obvious and boring and the rest was a weird hodgepodge. Significantly, there is no consideration given for whether the person wanting the rank likes to play jazz or metal or country or has small hands or requires active electronics or likes trems or whatever. So it’s a fine exercise in showing llms doing a thing, but adds little/no value over just doing a web search. Or, more appropriately, having a conversation with an experienced guitar player about what I want in a guitar.
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#36Cute but why? Human-based rankings rarely align and for good reason. In ranking, you are reducing multiple quantitative and qualitative attributes (and their combinations) to a single dimension. You will lose information. To illustrate further, I picked “electric guitars”. The top two were obvious and boring and the rest was a weird hodgepodge. Significantly, there is no consideration given for whether the person wan…
We absolutely do lose information here; that's a great point. The goal for us wasn't necessarily to surface the best ranking; it was to learn how LLMs produce a given ranking and what sources it pulls in.
The nugget of real interest here (personally speaking) is in those citations: what is the new meta for products getting ranked/referred by LLMs?
Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
#37> we’re interested in seeing how AI decides to recommend products, especially now that they are actively searching the web. So how does it work then? My naive assumption would be that it’s largely a hybrid LLM + crawled index, so still based on existing search engines that prioritise based on backlinks and a bunch of other content-based signals. If LLMs replace search, how do marketers rank higher? More of the same?…
> How does it work?
We don't know! We built this to learn a little bit more. We've seen that LLMs tend to prefer user-generated content (sites such as wikipedia, reddit, etc.) and strangely even youtube.
> How do marketers rank higher? Will LLMs prioritize other LLM content? At least so far, LLMs and search engines tend to downrank LLM created content. I could see this becoming indistinguishable in the future and/or LLMs surpassing humans in terms of effectively generating what reads as "original content"
> Who will pull the strings? At this point, it seems like whoever owns the models. Maybe we'll see ads in AI search soon.
https://www.tryprofound.com/_next/static/media/honeymoon-des...
