Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini "duck" demo was not done in realtime or with voice

twitter.com

Post reply on HN
Print view View original

301–310 of 683 posts

Re: Gemini "duck" demo was not done in realtime or with voice

#301

Post by hot_gril »

DonnyV wrote: post #259

This is so crazy. Google invented transformers which is the bases for all these models. How do they keep fumbling like this over and over. Google Docs created in 2006! Microsoft is eating their lunch. Google creates the ability to change VM's in place and makes a fully automated datacenter. Amazon and Microsoft are killing them in the cloud. Google has been working on self driving longer than anyone. Tesla is catchin…

Engineer-driven company. Not enough top-down direction on the products. Too much self-perceived moral high ground. But lately they've been changing this.

Re: Gemini "duck" demo was not done in realtime or with voice

#302

Post by eviks »

modeless wrote: post #94

That's not the only thing wrong. Gemini makes a false statement in the video, serving as a great demonstration of how these models still outright lie so frequently, so casually, and so convincingly that you won't notice, even if you have a whole team of researchers and video editors reviewing the output. It's the single biggest problem with LLMs and Gemini isn't solving it. You simply can't rely on them when correctn…

Given the misleading presentation by real humans in these "whole teams" that this tweet corrects, this doesn't illustrate any underlying powers by the model

Re: Gemini "duck" demo was not done in realtime or with voice

#303

Post by LesZedCB »

davesque wrote: post #287

A big red flag for me was that Sundar was prompting the model to report lots of facts that can be either true or false. We all saw the benchmark figures that they published and the results mostly showed marginal improvements. In other words, the issue of hallucination has not been solved. But the demo seemed to imply that it had. My conclusion was that they had mostly cherry picked instances in which the model happen…

i think this was demonstrated in that mark rober promo video[1] where he asked why the paper airplane stalled by blatantly leading the witness.

"do you believe that a pocket of hot air would lead to lower air pressure causing my plane to stall?"

he could barely even phrase the question correctly because it was so awkward. just embarrassing.

[1] https://www.youtube.com/watch?v=mHZSrtl4zX0&t=277s

Re: Gemini "duck" demo was not done in realtime or with voice

#304

Post by bradhe »

mtrovo wrote: post #258

I guess a much better next step is to compare how GPT4V performs when asked similar prompts. Even if mostly staged this is very impressive to me, not much on the current tech but more on how much leverage Google has to win this race on the long run because of its hardware presence. The more these models improve the more we will want less friction and faster interactions, this means that in the long term having to ope…

> Even if mostly staged this is very impressive to me, not much on the current tech but more on how much leverage Google has to win this race on the long run because of its hardware presence.

I think you have too much information to form a reasonable opinion on the situation. Google is using editing techniques and specific scripting to try to demonstrate they have a sufficiently powerful general AI. The magnitude of this claim is huge, and the fact that they're faking it should be a likewise enormous scandal.

To sum this up "well I guess they're doing better than XYZ" discounts the absurd context of all this.

Re: Gemini "duck" demo was not done in realtime or with voice

#305

Post by oh_sigh »

eurleif wrote: post #270
modeless wrote: post #94

That's not the only thing wrong. Gemini makes a false statement in the video, serving as a great demonstration of how these models still outright lie so frequently, so casually, and so convincingly that you won't notice, even if you have a whole team of researchers and video editors reviewing the output. It's the single biggest problem with LLMs and Gemini isn't solving it. You simply can't rely on them when correctn…

To be fair, one could describe the duck as being made of air and vinyl polymer, which in combination are less dense than water. That's not how humans would normally describe it, but that's kind of arbitrary; consider how aerogel is often described as being mostly made of air.

If I take all of the air out of a toy duck, it is still a toy duck. If I take all of the vinyl/rubber out of a toy duck, it is just the atmosphere remaining

Re: Gemini "duck" demo was not done in realtime or with voice

#307

Post by hot_gril »

bradhe wrote: post #293
DonnyV wrote: post #259

This is so crazy. Google invented transformers which is the bases for all these models. How do they keep fumbling like this over and over. Google Docs created in 2006! Microsoft is eating their lunch. Google creates the ability to change VM's in place and makes a fully automated datacenter. Amazon and Microsoft are killing them in the cloud. Google has been working on self driving longer than anyone. Tesla is catchin…

Microsoft eating Google's lunch on documents is laughable at best. Not to mention it confuses the entire timeline of office productivity software??

Is paid MS Teams is more or less common than paid GSuite? It's hard to find stats on this. GSuite is the better product IMO, but MS has a stronger b2b reputation, and anecdotally I hear more about people using Teams.

Re: Gemini "duck" demo was not done in realtime or with voice

#308

Post by robbomacrae »

pizzafeelsright wrote: post #29

I suppose this is a great example of how trust in authentic videos, audio, images, company marketing must be questioned and, until verified, assumed to be 'generated'. I am curious, if the voice, email, chat, and shortly video can all be entirely generated in real or near real time, how can we be sure that remote employee is actually not a full or partially generated entity? Shared secrets are great when verifying bu…

I think it's also why we as a community should speak out when we catch them for doing this as they are discrediting tech demos. It won't be enough because a lie will be around the world before the truth gets out the starting gates but we can't just let this go unchecked.

Re: Gemini "duck" demo was not done in realtime or with voice

#309

Post by hollowturtle »

I didn’t believed Google presentation off-hand because I don’t care anymore, especially because it comes from them. I just use tools and adapt. Copilot helps me automating boring tasks, can’t help much at new stuff, so I actually discovered I often do “interesting” work. I use gpt 3.5/4 for everything but work, it’s been a bless, best suggestion engine for movies, books and music with just a prompt and without the need of tons of data about my watch history(looking at you youtube). In these strange times I’m actually learning a lot more, productivity is more or less the same as before llms, but annoying tasks are relieved a bit. All of that without the hype. Sometimes I laugh at Google, it must be a real shit show inside that mega corporation, but I kinda understand the need of a marketing editing, having a first class ticket on the AI train is so important for them as it seems they see it as an existential threat. At least it seems so since they decided to take the risk of lying.

Re: Gemini "duck" demo was not done in realtime or with voice

#310

Post by p1esk »

dylan604 wrote: post #227
bongodongobob wrote: post #205

Earlier quoted context omitted.

So what? People do this with Facebook news too. That's a people problem, not an LLM problem.

People on social media are absolutely 100% posting things deliberately to fuck with people. They are actively seeking to confuse people, cause chaos, divisiveness, and other ill intended purposes. Unless you're saying that the LLM developers are actively doing the same thing, I don't think comparing what people find on the socials vs getting back as a response from a chatBot is a logical comparison at all

There are far more people who post obviously wrong, confusing and dangerous things online with total conviction. There are people who seriously believe Earth is flat, for example.
Post reply on HN