Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

productrank.ai

Post reply on HN
Print view View original

1–10 of 37 posts

Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

#1

Post by the1024 »

Hi HN! AI Product Rank lets you to search for topics and products, and see how OpenAI, Anthropic, and Perplexity rank them. You can also see the citations for each ranking.

We’re interested in seeing how AI decides to recommend products, especially now that they are actively searching the web. Now that we can retrieve citations by API, we can learn a bit more about what sources the various models use.

This is increasingly becoming important - Guillermo Rauch said that ChatGPT now refers ~5% of Vercel signups, which is up 5x over the last six months. [1]

It’s been fascinating to see the somewhat strange sources that the models pull from; one hypothesis is that most of the high quality sources have opted out of training data, leaving a pretty exotic long tail of citations. For example, a search for car brands yielded citations including Lux Mag and a class action filing against Chevy for batteries. [2]

We'd love for you to give it a try and let me know what you think! What other data would you want to see?

[1] https://x.com/rauchg/status/1898122330653835656

[2] https://productrank.ai/topic/car-brands

Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity
productrank.ai

Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

#3

Post by joshdavham »

I like this idea and think it’s really creative! But for feedback I’d like to see more clarity on what you mean by “rankings”.

For example, I searched “Ways to die” and got 1. Drowning 2. Firearms 3. Death during sleep

What exactly is the ranking criteria here? (Also, sorry for goofy edge case haha)

Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

#5

Post by soco »

joshdavham wrote: post #3

I like this idea and think it’s really creative! But for feedback I’d like to see more clarity on what you mean by “rankings”. For example, I searched “Ways to die” and got 1. Drowning 2. Firearms 3. Death during sleep What exactly is the ranking criteria here? (Also, sorry for goofy edge case haha)

While maybe a fun exercise, I definitely don't expect (or require) such a recommendation from a product-ranking AI.

Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

#6

Post by 0x63_Problems »

joshdavham wrote: post #3

I like this idea and think it’s really creative! But for feedback I’d like to see more clarity on what you mean by “rankings”. For example, I searched “Ways to die” and got 1. Drowning 2. Firearms 3. Death during sleep What exactly is the ranking criteria here? (Also, sorry for goofy edge case haha)

These are structured results from explicitly asking the LLM for a ranking in the given category, and we provide guidance in the prompt telling the LLM to 'use best judgment' when the topic doesn't clearly include products.

Also we include the 'key features' from each answer - you can see this by clicking the cell containing the rank (e.g. '1st' in the Anthropic column)

In this case, Anthropic said of 'Death during sleep':

Anthropic Analysis for Death During Sleep

    Painless and unaware experience
    No anticipatory anxiety
    Common with certain cardiac conditions
    Often described as 'peaceful'
    No suffering

Re: Show HN: Comparing product rankings by OpenAI, Anthropic, and Perplexity

#10

Post by 0x63_Problems »

webscout wrote: post #4

Where do you get the list of products?

It's from previous searches actually, we have an 'enrichment' step after the initial rankings come back which helps with semantic deduplication and tries to give us a canonical website domain. We store the Product and tag all matching rankings: https://productrank.ai/product/microsoft and use a 3rd party to map website brand logo.
Post reply on HN