[flagged]
China has the second biggest output of AI/ML research after the US. So not that surprising.
Gemini AI
171–180 of 1001 posts
Re: Gemini AI
#172I asked Bard, "Are you running Gemini Pro now?" And it told me, "Unfortunately, your question is ambiguous. "Gemini Pro" could refer to..." and listed a bunch of irrelevant stuff. Is Bard not using Gemini Pro at time of writing? The blog post says, "Starting today, Bard will use a fine-tuned version of Gemini Pro for more advanced reasoning, planning, understanding and more." (EDIT: it is... gave me a correct answer…
I wonder the same too, also is Gemini Pro supposed to beat GPT-4?
I thought so too but no, Gemini _Ultra_ is supposed to beat GPT-4. The one available through Bard is Gemini Pro. The wording sure is confusing!
Looking at the technical report [1], on selected benchmarks, rounded score in %:
Dataset | Gemini Ultra | Gemini Pro | GPT-4
MMLU | 90 | 79 | 87
BIG-Bench-Hard | 84 | 75 | 83
HellaSwag | 88 | 85 | 95
Natural2Code | 75 | 70 | 74
WMT23 | 74 | 72 | 74
[1] https://storage.googleapis.com/deepmind-media/gemini/gemini_...
Re: Gemini AI
#173[flagged]
Why? Google is an international organization and its technical employment is heavily skewed towards these two origins. Also Americans come from other places? Regardless of their last name…
What is this about?
Re: Gemini AI
#174How do I use this?
Re: Gemini AI
#175Can anyone please de-lingo this for me? Is Gemini parallel to Bard or parallel to PaLM 2 or… something else?
In our experience OpenAI’s APIs and overall model quality (3.5, 4, trained, etc) is just way better across the board to the equivalent APIs available in Google Cloud Vertex.
Is Gemini supposed to be a new option (beyond PaLM 2) in Vertex? I literally can’t make heads or tails on what “it” is in practical terms to me.
Re: Gemini AI
#176I’m most curious about the efficiency of the model in terms of computer needed per query.
Well, the a fine tuned version of the Pro model now powers Bard - which is free; so it’s probably quite cheap (to Google at least).
Re: Gemini AI
#177> For Gemini Ultra, we’re currently completing extensive trust and safety checks, including red-teaming by trusted external parties, and further refining the model using fine-tuning and reinforcement learning from human feedback (RLHF) before making it broadly available. > As part of this process, we’ll make Gemini Ultra available to select customers, developers, partners and safety and responsibility experts for ear…
Well not exactly. Not coming out until later when presumably GPT4 will have grown as much as well. So far each time, Google has failed to catch up to OpenAI. Hopefully they do however eventually.
> presumably GPT4 will have grown as much as well
Most of the comments I see on Hacker News claim ChatGPT is getting worse at different things (though I don't believe those claims).
Re: Gemini AI
#178> For Gemini Ultra, we’re currently completing extensive trust and safety checks, including red-teaming by trusted external parties, and further refining the model using fine-tuning and reinforcement learning from human feedback (RLHF) before making it broadly available. > As part of this process, we’ll make Gemini Ultra available to select customers, developers, partners and safety and responsibility experts for ear…
Well not exactly. Not coming out until later when presumably GPT4 will have grown as much as well. So far each time, Google has failed to catch up to OpenAI. Hopefully they do however eventually.
Even if they're perpetually a year behind, that's a strong competitive spur to keep OpenAI on the move.
Re: Gemini AI
#179I asked Bard, "Are you running Gemini Pro now?" And it told me, "Unfortunately, your question is ambiguous. "Gemini Pro" could refer to..." and listed a bunch of irrelevant stuff. Is Bard not using Gemini Pro at time of writing? The blog post says, "Starting today, Bard will use a fine-tuned version of Gemini Pro for more advanced reasoning, planning, understanding and more." (EDIT: it is... gave me a correct answer…
Your line of thinking also presupposes that Bard is self aware about that type of thing. You could also ask it what programming language it's written in, but that doesn't mean it knows and/or will answer you.
It has access to the Internet and is free to search for the right answer.
If I ask it who it is, it says it is Bard. It is aware of the launch that occurred today. It cites December 6th.
It just very incorrectly felt that I was asking an ambiguous question until I restate the same question again. It's not great.
Re: Gemini AI
#180So, better than GPT4 according to the benchmarks? Looks very interesting. Technical paper: https://goo.gle/GeminiPaper Some details: - 32k context length - efficient attention mechanisms (for e.g. multi-query attention (Shazeer, 2019)) - audio input via Universal Speech Model (USM) (Zhang et al., 2023) features - no audio output? (Figure 2) - visual encoding of Gemini models is inspired by our own foundational work o…
That's for Ultra right? Which is an amazing accomplishment, but it sounds like I won't be able to access it for months. If I'm lucky.
The article says "next year" - so that could be as soon as January, right?