They've reported surpassing GPT4 on several benchmarks. Does anyone know of these are hand picked examples or is this the new SOTA?
Gemini AI
11–20 of 1001 posts
Re: Gemini AI
#12So it's basically just GPT-4, according to the benchmarks, with a slight edge for multimodal tasks (ie audio, video).
Google does seem to be quite far behind, GPT-4 launched almost a year ago.
Re: Gemini AI
#13This marketing page feels very apple-like (and I mean that in a good way).
If the benchmarks are any indication, Gemini seems legit, excited to see what it can do.
Re: Gemini AI
#14Anywhere to actually run this?
Re: Gemini AI
#15Much more interesting link: https://deepmind.google/technologies/gemini/
And the technical report: https://storage.googleapis.com/deepmind-media/gemini/gemini_...
Re: Gemini AI
#16It's a shame that Gemini Ultra is not out yet, it seems like a solid improvement on GPT-4. I wonder how it'll compare against GPT-5?
Re: Gemini AI
#17Feels more like an Apple post "the best fastest blabla-est". How about making it available to try without the fluff?
Re: Gemini AI
#18Anywhere to actually run this?
Bard is apparently based on gemini pro from today, pro is coming via api on the 13th and ultra is still in more "select developers" starting next year.
Re: Gemini AI
#19They've reported surpassing GPT4 on several benchmarks. Does anyone know of these are hand picked examples or is this the new SOTA?
They certainly claim it is SOTA for multimodal tasks: “Gemini surpasses SOTA performance on all multimodal tasks.”
Re: Gemini AI
#20> For Gemini Ultra, we’re currently completing extensive trust and safety checks, including red-teaming by trusted external parties, and further refining the model using fine-tuning and reinforcement learning from human feedback (RLHF) before making it broadly available. > As part of this process, we’ll make Gemini Ultra available to select customers, developers, partners and safety and responsibility experts for ear…
>Finally, some competition for GPT4 API!!! This is such good news. Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.
I’m curious which instances of overpromising you’re referring to.