Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Deep Research is now available on Gemini 2.5 Pro Experimental

blog.google

Post reply on HN
Print view View original

21–26 of 26 posts

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#21

Post by phonon »

nico wrote: post #5
infecto wrote: post #3

Has anyone tested googles functionality vs ChatGPT? I have lightly played around with it but felt that generally ChatGPTs implementation was a little more educated sounding and felt like it took whatever necessary persona well.

Just did a test last week and OpenAIs research was way better. Found 10x more sources and did an overall pretty great job The task was to lookup information about a late distant family member who had been a prominent employee in a certain foreign government about 100 years ago Gemini barely scratched the surface and pretty much gave up ChatGPT on the other hand, kept building up on its research, connecting the dots a…

But this is a brand new version? Why not run it again on Gemini 2.5 Deep Research mode and report if it's better?

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#22

Post by DadBase »

esperent wrote: post #8
DadBase wrote: post #6

Deep research used to mean spending a weekend with grep and a coffee pot. Now it’s just autocomplete with a confidence interval.

> with grep Maybe for an extremely limited number of people. For the rest of the world, it meant searching the web, books, or scholarly publications, reading a ton, taking notes, and then possibly creating a report. Which is pretty much exactly what these AI agents are claimed to to, so deep research is the perfect name for it. Whether or not they are good at it compared to humans is a question that hasn't been answe…

Back then, grep was how you searched the scholarly publications—assuming you’d mirrored the arXiv to a local FTP server like any serious researcher. The notes were just comments in the Makefile.

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#23

Post by infecto »

nico wrote: post #5
infecto wrote: post #3

Has anyone tested googles functionality vs ChatGPT? I have lightly played around with it but felt that generally ChatGPTs implementation was a little more educated sounding and felt like it took whatever necessary persona well.

Just did a test last week and OpenAIs research was way better. Found 10x more sources and did an overall pretty great job The task was to lookup information about a late distant family member who had been a prominent employee in a certain foreign government about 100 years ago Gemini barely scratched the surface and pretty much gave up ChatGPT on the other hand, kept building up on its research, connecting the dots a…

I do think they are leaps in front of everyone else from the product perspective and everyday its looking more to be the battleground where money is going to be made.

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#24

Post by esperent »

DadBase wrote: post #22
esperent wrote: post #8

Earlier quoted context omitted.

> with grep Maybe for an extremely limited number of people. For the rest of the world, it meant searching the web, books, or scholarly publications, reading a ton, taking notes, and then possibly creating a report. Which is pretty much exactly what these AI agents are claimed to to, so deep research is the perfect name for it. Whether or not they are good at it compared to humans is a question that hasn't been answe…

Back then, grep was how you searched the scholarly publications—assuming you’d mirrored the arXiv to a local FTP server like any serious researcher. The notes were just comments in the Makefile.

Ah, only a true Scotsman ever did real deep research. Got it.

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#25

Post by SequoiaHope »

consumer451 wrote: post #7
nico wrote: post #5

Earlier quoted context omitted.

Just did a test last week and OpenAIs research was way better. Found 10x more sources and did an overall pretty great job The task was to lookup information about a late distant family member who had been a prominent employee in a certain foreign government about 100 years ago Gemini barely scratched the surface and pretty much gave up ChatGPT on the other hand, kept building up on its research, connecting the dots a…

Would love to see this repeated with this latest version from Google. Man, what's really missing from all of this is a 3rd party AI Consumer Reports type site for all of these LLM tools. Whoever does this thing that does not scale will have a highly referenced site on their hands.

I suppose Consumer Reports could do it!

Re: Deep Research is now available on Gemini 2.5 Pro Experimental

#26

Post by consumer451 »

consumer451 wrote: post #19
shigawire wrote: post #13

Earlier quoted context omitted.

Isn't that what llmarena does?

It tries to in a way that scales easily, and is also easily gamed. I want a staff of human testers, each with domain expertise. If the goal is to replace humans, should there not be a real human metric? I want a physicist asking their battery of physics questions, 4 different kinds of devs asking their battery of dev problems, a couple chefs asking for cooking techniques, etc. Now on to "Deep Research," 6 different k…

^ I really should have used the "myopic," instead of "brain dead" to describe the C-Suites of the world. My apologies.
Post reply on HN