Gemini AI • Hacker News Board

Re: Gemini AI

#361

Post by relativeadv » Wed, Dec 06, 2023, 5:18 PM UTC

milesward wrote: post #136

This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX

its quacktastic

https://www.youtube.com/watch?app=desktop&v=kp2skYYA2B4

Re: Gemini AI

#362

Post by EZ-E » Wed, Dec 06, 2023, 5:19 PM UTC

SeanAnderson wrote: post #340

Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…

Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.

Re: Gemini AI

#363

Post by blev » Wed, Dec 06, 2023, 5:19 PM UTC

mg wrote: post #293

To test whether bard.google.com is already updated in your region, this prompt seems to work: Which version of Bard am I using? Here in Europe (Germany), I get: The current version is Bard 2.0.3. It is powered by the Google AI PaLM 2 model Considering that you have to log in to use Bard while Bing offers GPT-4 publicly and that Bard will be powered by Gemini Pro, which is not the version that they say beats GPT-4, it…

It's probably hallucinating that versioning. You can't trust LLMs to provide info about themselves.

Re: Gemini AI

#364

Post by raymond_goo » Wed, Dec 06, 2023, 5:19 PM UTC

Govern me harder daddy!

Re: Gemini AI

#365

Post by SiempreViernes » Wed, Dec 06, 2023, 5:20 PM UTC

quackery1 wrote: post #331

ACS_Solver wrote: post #267

Earlier quoted context omitted.

To quote Gemini, what the quack! Even with the understanding that these are handpicked interactions that are likely to be among the system's best responses, that is an extremely impressive level of understanding and reasoning.

Does it really need to have affectations like "What the quack!"? These affectations are lab grown and not cute.

I guess it's like drawing googly eyes on clippy: it helps sell the illusion that you are interacting with something alive instead of an automatic system.

Re: Gemini AI

#366

Post by aaronharnly » Wed, Dec 06, 2023, 5:23 PM UTC

IanCal wrote: post #299

aaronharnly wrote: post #183

I did some side-by-side comparisons of simple tasks (e.g. "Write a WCAG-compliant alternative text describing this image") with Bard vs GPT-4V. Bard's output was significantly worse. I did my testing with some internal images so I can't share, but will try to compile some side-by-side from public images.

Bard with pro is apparently text only: > Important: For now, Bard with our specifically tuned version of Gemini Pro works for text-based prompts, with support for other content types coming soon. https://support.google.com/bard/answer/14294096 I'm in the UK and it's not available here yet - I really wish they'd be clearer about what I'm using, it's not the first time this has happened.

Huh! It has an image upload, and gives somewhat responsive, just not great, responses, so I'm a bit confused by that. So this is the existing Lens implementation?

Re: Gemini AI

#367

Post by therealdrag0 » Wed, Dec 06, 2023, 5:23 PM UTC

huytersd wrote: post #143

[flagged]

Asians are high achievers. Majority of my employers ML team is Asian. Majority of my spouses top tier school engineering club is Asian.

Re: Gemini AI

#368

Post by belval » Wed, Dec 06, 2023, 5:24 PM UTC

norir wrote: post #256

This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…

Don't look at absolute number, instead think of it in terms of relative improvement.

DocVQA is a benchmark with a very strong SOTA. GPT-4 achieves 88.4, Gemini 90.9. It's only 2.5% increase, but a ~22% error reduction which is massive for real-life usecases where the error tolerance is lower.

Re: Gemini AI

#369

Post by johnfn » Wed, Dec 06, 2023, 5:25 PM UTC

norir wrote: post #256

This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…

Interesting, but hard to conclude just from one datapoint. An alternate interpretation is that, given how far Bard lagged behind GPT until this moment, it's a stunning advancement.

Re: Gemini AI

#370

Post by globular-toast » Wed, Dec 06, 2023, 5:26 PM UTC

milesward wrote: post #136

This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX

It seems weird to me. He asked it to describe what it sees, why does it randomly start spouting irrelevant facts about ducks? And is it trying to be funny when it's surprised about the blue duck? Does it know it's trying to be funny or does it really think it's a duck?

I can't say I'm really looking forward to a future where learning information means interacting with a book-smart 8 year old.