Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini AI

deepmind.google

Post reply on HN
Print view View original

441–450 of 1001 posts

Re: Gemini AI

#441

Post by corethree »

tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

Didn't Google invent LLMs and didn't Google have an internal LLm with similar capabilities long before openai released the gpts? Remember when that guy got fired for making a claim it was conscious ?

The look isn't good. But it's not dishonest.

Re: Gemini AI

#442

Post by crossroadsguy »

hinkley wrote: post #266
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

Sundar studied material science in school and is only slightly older than me. Google is a little over 25 years old. I guarantee you they have not been doing AI since I was a baby. And how many financial people worth reconning with are under 30 years old? Not many.

Unless you are OpenAI, the company, I doubt OP implied it was aimed at you. But then I wouldn't know as I am much younger than Sundar Pichai and I am not on first name basis with him either ;-)

Re: Gemini AI

#443

Post by sinuhe69 »

mg wrote: post #293

To test whether bard.google.com is already updated in your region, this prompt seems to work: Which version of Bard am I using? Here in Europe (Germany), I get: The current version is Bard 2.0.3. It is powered by the Google AI PaLM 2 model Considering that you have to log in to use Bard while Bing offers GPT-4 publicly and that Bard will be powered by Gemini Pro, which is not the version that they say beats GPT-4, it…

With the rules in the EU, I think Google should be careful about releasing anything new in the EU space. Who knows, maybe some parents or schools will sue Google for helping the kids doing math homework!

Btw, Bard with Gemini has indeed improved the answer quality significantly, especially in coding and logics questions.

Re: Gemini AI

#444

Post by johnfn »

Very impressive! I noticed two really notable things right off the bat:

1. I asked it a question about a feature that TypeScript doesn't have[1]. GPT4 usually does not recognize that it's impossible (I've tried asking it a bunch of times, it gets it right with like 50% probability) and hallucinates an answer. Gemini correctly says that it's impossible. The impressive thing was that it then linked to the open GitHub issue on the TS repo. I've never seen GPT4 produce a link, other than when it's in web-browsing mode, which I find to be slower and less accurate.

2. I asked it about Pixi.js v8, a new version of a library that is still in beta and was only posted online this October. GPT4 does not know it exists, which is what I expected. Gemini did know of its existence, and returned results much faster than GPT4 browsing the web. It did hallucinate some details, but it correctly got the headline features (WebGPU, new architecture, faster perf). Does Gemini have a date cutoff at all?

[1]: My prompt was: "How do i create a type alias in typescript local to a class?"

Re: Gemini AI

#445

Post by viscanti »

Palmik wrote: post #324
albertzeyer wrote: post #42

So, better than GPT4 according to the benchmarks? Looks very interesting. Technical paper: https://goo.gle/GeminiPaper Some details: - 32k context length - efficient attention mechanisms (for e.g. multi-query attention (Shazeer, 2019)) - audio input via Universal Speech Model (USM) (Zhang et al., 2023) features - no audio output? (Figure 2) - visual encoding of Gemini models is inspired by our own foundational work o…

The table is *highly* misleading. It uses different methodologies all over the place. For MMLU, it highlights the CoT @ 32 result, where Ultra beats GPT4, but it loses to GPT4 with 5-shot, for example. For GSM8K it uses Maj1@32 for Ultra and 5-shot CoT for GPT4, etc. Then also, for some reason, it uses different metrics for Ultra and Pro, making them hard to compare. What a mess of a "paper".

The places where they use the same methodology seem within the error bars of the cherry picked benchmarks they selected. Maybe for some tasks it's roughly comparable to GPT4 (still a major accomplishment for Google to come close to closing the gap for the current generation of models), but this looks like someone had the goal of showing Gemini beating GPT4 in most areas and worked back from there to figure out how to get there.

Re: Gemini AI

#446

Post by visarga »

dist-epoch wrote: post #354
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

> show instead of tell They showed AlphaGo, they showed Transformers. Pretty good track record.

That was ages ago. In AI even a week feels like a whole year in other fields. And many/most of those researchers have fled to startups, so those startups also have a right to brag. But not too much - only immediate access to a model beating GPT4 is worth bragging today (cloud), or getting GPT3.5 quality from a model running on a phone (edge).

So it's either free-private-gpt3.5 or cloud-better-than-gpt4v. Nothing else matters now. I think we have reached an extreme point of temporal discounting (https://en.wikipedia.org/wiki/Time_preference).

Re: Gemini AI

#447

Post by ametrau »

EZ-E wrote: post #362
SeanAnderson wrote: post #340

Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…

Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.

I wonder what advertising will look like with this. Will they suggest products in the response? Like “Top ideas:…” and the LLM’s response.

Re: Gemini AI

#448

Post by miraculixx »

arnaudsm wrote: post #225
albertzeyer wrote: post #42

So, better than GPT4 according to the benchmarks? Looks very interesting. Technical paper: https://goo.gle/GeminiPaper Some details: - 32k context length - efficient attention mechanisms (for e.g. multi-query attention (Shazeer, 2019)) - audio input via Universal Speech Model (USM) (Zhang et al., 2023) features - no audio output? (Figure 2) - visual encoding of Gemini models is inspired by our own foundational work o…

I miss when ML scientific papers had actual science in them. Now they all feel like ads.

If it feals like a duck it is a duck. Duh(ck)

Re: Gemini AI

#449

Post by sinuhe69 »

IanCal wrote: post #299
aaronharnly wrote: post #183

I did some side-by-side comparisons of simple tasks (e.g. "Write a WCAG-compliant alternative text describing this image") with Bard vs GPT-4V. Bard's output was significantly worse. I did my testing with some internal images so I can't share, but will try to compile some side-by-side from public images.

Bard with pro is apparently text only: > Important: For now, Bard with our specifically tuned version of Gemini Pro works for text-based prompts, with support for other content types coming soon. https://support.google.com/bard/answer/14294096 I'm in the UK and it's not available here yet - I really wish they'd be clearer about what I'm using, it's not the first time this has happened.

You can ask Bard directly! Unlike ChatGPT, Bard can answer many things about itself.

Re: Gemini AI

#450

Post by pb7 »

rvnx wrote: post #410
SeanAnderson wrote: post #340

Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…

Not just Europe: also no Canada, China, Russia, United Kingdom, Switzerland, Bulgaria, Norway, Iceland, etc.

> Not just Europe, also no [mostly European countries]

EU is not Europe.

Post reply on HN