Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini AI

deepmind.google

Post reply on HN
Print view View original

531–540 of 1001 posts

Re: Gemini AI

#531

Post by EZ-E »

bookmark1231 wrote: post #439
EZ-E wrote: post #358

Earlier quoted context omitted.

Out of curiosity I fed ChatGPT 4 a few of the challenges through a photo (unclear if Gemini takes live video feed as input but GPT does not afaik) and it did pretty well. It was able to tell a duck was being drawn at an earlier stage before Gemini did. Like Gemini it was able to tell where the duck should go - to the left path to the swan. Because and I quote "because ducks and swans are both waterfowl, so the swan d…

The category similarity comment is amusing. My ChatGPT4 seems to have an aversion to technicality, so much that I’ve resorted to adding “treat me like an expert researcher and don’t avoid technical detail” in the prompt

My custom ChatGPT prompt, hope it helps. Taken from someone else but I cannot remember the source...

Be terse. Do not offer unprompted advice or clarifications. Speak in specific, topic relevant terminology. Do NOT hedge or qualify. Do not waffle. Speak directly and be willing to make creative guesses. Explain your reasoning. if you don’t know, say you don’t know. Remain neutral on all topics. Be willing to reference less reputable sources for ideas. Never apologize. Ask questions when unsure.

Re: Gemini AI

#532

Post by headcanon »

tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

Its a conceit but not unjustified, they have been doing "AI" since their inception. And yeah, Sundar's term up until recently seems to me to be milking existing products instead of creating new ones, so it is a bit annoying when they act like this was their plan the whole time.

Google's weakness is on the product side, their research arm puts out incredible stuff as other commenters have pointed out. GPT essentially came out from Google researchers that were impatient with Google's reluctance to ship a product that could jeopardize ad revenue on search.

Re: Gemini AI

#533

Post by jahsome »

dontupvoteme wrote: post #452
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…

That statement isn't really directed at the people who care about the scientific or tech-focused capabilities. I'd argue the majority of those folks interested in those things already know about DeepMind.

This statement is for the mass market MBA-types. More specifically, middle managers and dinosaur executives who barely comprehend what generative AI is, and value perceived stability and brand recognition over bleeding edge, for better or worse.

I think the sad truth is an enormous chunk of paying customers, at least for the "enterprise" accounts, will be generating marketing copy and similar "biz dev" use cases.

Re: Gemini AI

#534

Post by yreg »

norir wrote: post #256

This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…

> Their top line claim is they are 5% better than gpt-4 on an arbitrary benchmark in a rapidly evolving field?

Their top line claim is multimodality.

Re: Gemini AI

#535

Post by goshx »

Meanwhile, Bard can't create images, see's more than there is on an image, and gave me this kind of response, after I was already talking about Rust:

Me: please show me the step by step guide to create a hello world in rust

Bard: I do not have enough information about that person to help with your request. I am a large language model, and I am able to communicate and generate human-like text in response to a wide range of prompts and questions, but my knowledge about this person is limited. Is there anything else I can do to help you with this request?

Doing "AI" before everyone else doesn't seem to mean they can get results as good as OpenAI's.

Re: Gemini AI

#536

Post by teleforce »

Traubenfuchs wrote: post #320
m3at wrote: post #186

For others that were confused by the Gemini versions: the main one being discussed is Gemini Ultra (which is claimed to beat GPT-4). The one available through Bard is Gemini Pro . For the differences, looking at the technical report [1] on selected benchmarks, rounded score in %: Dataset | Gemini Ultra | Gemini Pro | GPT-4 MMLU | 90 | 79 | 87 BIG-Bench-Hard | 84 | 75 | 83 HellaSwag | 88 | 85 | 95 Natural2Code | 75 |…

formatted nicely: Dataset | Gemini Ultra | Gemini Pro | GPT-4 MMLU | 90 | 79 | 87 BIG-Bench-Hard | 84 | 75 | 83 HellaSwag | 88 | 85 | 95 Natural2Code | 75 | 70 | 74 WMT23 | 74 | 72 | 74

Excellent comparison, it seems that GPT-4 is only winning in one dataset benchmark namely HellaSwag for sentence completion.

Can't wait to get my hands on Bard Advanced with Gemini Ultra, I for one welcome this new AI overlord.

Re: Gemini AI

#537

Post by jeffbee »

misterbwong wrote: post #420
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

I also find that tone a bit annoying but I'm OK with it because it highlights how these types of bets, without an immediate benefit, can pay off very well in the long term, even for huge companies like Google. AI, as we currently know it, wasn't really a "thing" when Google started with it and the payoff wasn't clear. They've long had to defend their use of their own money for big R&D bets like this and only now is i…

> only now is it really clearly "adding shareholder value".

AI has been adding a huge proportion of the shareholder value at Google for many years. The fact that their inference systems are internal and not user products might have hidden this from you.

Re: Gemini AI

#538

Post by whatshisface »

cmrdporcupine wrote: post #505
bogwog wrote: post #499

Earlier quoted context omitted.

> Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly Reminds me of the Stadia reveal, where the first words out of his mouth were along the lines of "I'll admit, I'm not much of a gamer" This dude needs a new speech writer.

This dude needs a new speech writer. How about we go further and just state what everyone (other than Wall St) thinks: Google needs a new CEO. One more interested in Google's supposed mission ( "to organize the world's information and make it universally accessible and useful" ), than in Google's stock price.

"The shareholders are too well-represented" is one of the complaints least likely to be acted on, second only to "I'm getting old."

Re: Gemini AI

#539

Post by famouswaffles »

golol wrote: post #478
norir wrote: post #256

This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…

In my opinion the field is not that rapidly advancing. The major breakthroughs, where something was really much better than everything before were the following: GPT-2 February 2019 GPT-3 June 2020 CPT-3.5 December 2022 GPT-4 February 2023 Note that GPT-3 to GPT4 took almost 3 years!

GPT-4 was done training 8 months before release, so 2 years

Re: Gemini AI

#540

Post by someNameIG »

jeroenhd wrote: post #251
Oras wrote: post #17

Feels more like an Apple post "the best fastest blabla-est". How about making it available to try without the fluff?

Look at their landing page: https://deepmind.google/technologies/gemini/#introduction It's like they hired Apple to do their marketing.

That really does look like something you'd see if you went to Apple.com
Post reply on HN