The improvement over ChatGPT are counted in (very) few percents. Does it mean they have entered a diminishing returns phase or is it that each percent is much harder to get compared to the previous ones ?
Gemini AI
111–120 of 1001 posts
Re: Gemini AI
#112What is up with that eval @32? Am I reading it correctly that they are generating 32 responses and taking majority? Who will use the API like that? That feels like such a fake way to improve metrics
[0] https://storage.googleapis.com/deepmind-media/gemini/gemini_...
Re: Gemini AI
#113OK, I'll keep using GPT-4 then. Now OpenAI has a target performance and timeframe to beat for GPT-5. It's a race!
Re: Gemini AI
#114I find it surprising that they only released Pro today, but didn't release the stats for Pro. Are those hidden somewhere else or are they not public?
Taking a different view on this release, the announcement reads, "We released a model that is still worse than GPT4 and, sometime later, we will release a model that is better than GPT4." which is not nearly as exciting.
Re: Gemini AI
#115Re: Gemini AI
#116So, better than GPT4 according to the benchmarks? Looks very interesting. Technical paper: https://goo.gle/GeminiPaper Some details: - 32k context length - efficient attention mechanisms (for e.g. multi-query attention (Shazeer, 2019)) - audio input via Universal Speech Model (USM) (Zhang et al., 2023) features - no audio output? (Figure 2) - visual encoding of Gemini models is inspired by our own foundational work o…
That's for Ultra right? Which is an amazing accomplishment, but it sounds like I won't be able to access it for months. If I'm lucky.
Re: Gemini AI
#117it's really amazing how in IT we always recycle the same ten names... in the last three years, "gemini" refers (at least) to: - gemini protocol, the smolnet companion (gemini://geminiprotocol.net/ - https://geminiprotocol.net/ ) - gemini somethingcoin somethingcrypto (I will never link it) - gemini google's ML/AI (here we are)
Naming things is one of the two hardest problems in computer science, after all.
Re: Gemini AI
#118They've reported surpassing GPT4 on several benchmarks. Does anyone know of these are hand picked examples or is this the new SOTA?
It will be SOTA maybe when Gemini Ultra is available. GPT-4 is still SOTA.
Re: Gemini AI
#119Feels more like an Apple post "the best fastest blabla-est". How about making it available to try without the fluff?
I'm not a marketer but it's hard to see what the point of these glossy press releases without a call to action is. If I could have tried it today, I would have dropped everything and tried it. Now I will forget about it for a while and try it whenever I hear through osmosis that it's available. To the extent that I am excited and/or interested, the snooze button is pressed. Maybe that's the desired outcome?
Re: Gemini AI
#120Apple lost the PC battle, MS lost the mobile battle, Google is losing the AI battle. You can't win everywhere.
Beautifully said. So basically: Apple lost the PC battle and won mobile, Microsoft lost the mobile battle and (seemingly) is winning AI, Google is losing the AI battle, but will win .... the Metaverse? Immersive VR? Robotics?