Are there good benchmarks for this type of tool? It seems not?
Also, I'd compare with the output of phind (with thinking and multiple searches selected).
Perplexity Deep Research
31–40 of 180 posts
Re: Perplexity Deep Research
#32In about 2 weeks since OpenAI launched their $200/mo version of Deep Research, it has already been open sourced within 24 hours (Hugging Face) and now being offered for free by Perplexity. The pace of disruption is mind boggling and makes you wonder if OpenAI has any moats left.
As a current OpenAI subscriber (just the regular $20/mo plan), I'm happy to not spend the effort switching as long as they stay within a few negligible percent of the State of the Art. I tried DeepSeek, it's fine, had some downtime, whatever, I'll just stick with 4o. Claude is also fine, not noticeably better to the point where I care to switch. OAI has my chat history which is worth something I suppose - maybe a wee…
4o isn’t really comparable to deepseek r1. Use o3-mini-high or o1 if you wanna stay near the state of the art.
Re: Perplexity Deep Research
#33Earlier quoted context omitted.
[flagged]
You are a bit behind. All the "deep research" tools, and paid AI search tools in general, combine LLMs with search. When I do research on you.com it routinely searches a 100 sites. Even Google searches get Gemini'd now. I had to chuckle because your very link provides a demonstration.
> You are a bit behind.
Quite the opposite. I'm familiar enough with these systems to know that asking the question "List the college majors of all Fortune 100 CEOs" is not going to get you a correct answer, Gemini and you.com included. I am happy to be proven wrong. :)
Re: Perplexity Deep Research
#34[flagged]
Have you tried talking to it nicely to see if it works every time? :D
Those sweet days are long past. Only weathered cynicism and chronic fatigue prevails.
Occasionally, to amuse myself, I'll read the records I've preserved. I have, largely due to boredom and OCD, large texts, PDFs and saved sessions where after long extruded conversations, I have the mutant idiot "examine the entire session history" and analyze its own pathological behavior. The self loathing initially compelled a measure of sympathy until I realized the intractably treacherous and deceptive nature of the monster.
There's a reason they named it so, but I think Gaslight would be more apropos.
Re: Perplexity Deep Research
#35Any evaluation of hallucination?
Re: Perplexity Deep Research
#36Are there good benchmarks for this type of tool? It seems not? Also, I'd compare with the output of phind (with thinking and multiple searches selected).
The best practical benchmark I found is asking LLMs to research or speak on my field of expertise.
Re: Perplexity Deep Research
#37That's the third product to use "Deep Research" in its name. The first was Gemini Deep Research: https://blog.google/products/gemini/google-gemini-deep-resea... - December 11th 2024 Then ChatGPT Deep Research: https://openai.com/index/introducing-deep-research/ - February 2nd 2025 Now Perplexity Deep Research: https://www.perplexity.ai/hub/blog/introducing-perplexity-de... - February 14th 2025.
Is there a problem with this if it's not trademarked? It's like saying Apple Maps is the nth product called "Maps". I, for one, am glad they are standardising on naming of equivalent products and wish they would do it more (eg. "reasoning" vs "thinking", "advanced voice mode" vs "live")
Not a trademark lawyer, but I don’t think Deep Research qualifies for trademark protection because it is “merely descriptive” of the product’s features. The only way to get a trademark like that is through “acquired distinctiveness”, but that takes 5 years of exclusive use and all these competitors will make that route impossible.
Re: Perplexity Deep Research
#38That's the third product to use "Deep Research" in its name. The first was Gemini Deep Research: https://blog.google/products/gemini/google-gemini-deep-resea... - December 11th 2024 Then ChatGPT Deep Research: https://openai.com/index/introducing-deep-research/ - February 2nd 2025 Now Perplexity Deep Research: https://www.perplexity.ai/hub/blog/introducing-perplexity-de... - February 14th 2025.
[deleted]
Re: Perplexity Deep Research
#39That's the third product to use "Deep Research" in its name. The first was Gemini Deep Research: https://blog.google/products/gemini/google-gemini-deep-resea... - December 11th 2024 Then ChatGPT Deep Research: https://openai.com/index/introducing-deep-research/ - February 2nd 2025 Now Perplexity Deep Research: https://www.perplexity.ai/hub/blog/introducing-perplexity-de... - February 14th 2025.
https://www.emergentmind.com also offers Deep Research on ArXiv papers (experimental)
Re: Perplexity Deep Research
#40Are there good benchmarks for this type of tool? It seems not? Also, I'd compare with the output of phind (with thinking and multiple searches selected).
The best practical benchmark I found is asking LLMs to research or speak on my field of expertise.
Yeah...and it didn't cite me :)