Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…
Why do they gate access at country level if it's about language. I live in Europe and speak English just fine. Can't they just offer it in English only until the multi-language support is ready?
Gemini AI
661–670 of 1001 posts
Re: Gemini AI
#662One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
I find this video really freaky. It’s like Gemini is a baby or very young child and also a massively know it all adult that just can’t help telling how clever it is and showing off its knowledge. People speak of the uncanny valley in terms of appearance. I am getting this from Gemini. It’s sort of impressive but feels freaky at the same time. Is it just me?
Re: Gemini AI
#663Earlier quoted context omitted.
OpenAI had an almost five-year head-start with relevant data acquisition and sorting, which is the most important part of these models.
Google has the biggest proprietary moat of information of any company in the world I'm sure.
We might soon get to a point where every player is using pretty much all the low-cost data there is. Everyone will use all the public internet data there is, augmented by as much private datasets as they can afford.
The improvements we can expect to see in the next few years look like a Drake equation.
LLM performance delta = data quality x data quantity x transformer architecture tweaks x compute cost x talent x time.
The ceiling for the cost parameters in this equation are determined by expected market opportunity, at the margin - how much more of the market can you capture if you have the better tech.
Re: Gemini AI
#664Earlier quoted context omitted.
I think it’s so strange how Pro wasn’t launched for Bard in Europe yet. I thought Bard was already cleared for EU use following their lengthy delay, and that this clearance wouldn’t be a recurring issue to overcome for each new underlying language model. Unless it’s technically hard to NOT train it on your data or whatever. Weird.
I suspect this is because inference is very expensive (much like GPT-4) and their expected ARPU (average revenue per user) in Europe is just not high enough to be worth the cost. See disposable income per capita (in PPP dollars): https://en.m.wikipedia.org/wiki/Disposable_household_and_per...
My guess is the delay is due to GDPR or other regulatory challenges.
Re: Gemini AI
#665Earlier quoted context omitted.
> I've never seen GPT4 produce a link, other than when it's in web-browsing mode, which I find to be slower and less accurate. Really? I've been using gpt4 since about April and it used to very often create links for me. I'll tell it hey I want to find a company that does X in Y city and it generates 5 links for me, and at least one of them is usually real and not hallucinated
It's amazing to me how low the bar is for AI to impress people. Really, 80% of the links were hallucinated, and that's somehow more useful than Kagi for [checks notes] finding real links? Can you imagine if you did a search on Google and 80% of the results weren't even real websites? We'd all still be using AltaVista! What on earth kind of standard is "1/5 results actually exist!" -- no comment on whether the 1/5 rea…
Re: Gemini AI
#666It's more on the level of GPT3.5 maybe not even.
Re: Gemini AI
#667Earlier quoted context omitted.
Agreed. The whole things reeks of being desperate. Half the video is jerking themselves off that they've done AI longer than anyone and they "release" (not actually available in most countries) a model that is only marginally better than the current GPT4 in cherry-picked metrics after nearly a year of lead-time?!?! That's your response? Ouch.
I worked at Google up through 8 weeks ago and knew there _had_ to be a trick -- You know those stats they're quoting for beating GPT-4 and humans? (both are barely beaten) They're doing K = 32 chain of thought. That means running an _entire self-talk conversation 32 times_. Source: https://storage.googleapis.com/deepmind-media/gemini/gemini_... , section 5.1.1 paragraph 2
Re: Gemini AI
#668This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…
I don’t think we can declare a plateau just based on this. Actually, given that we have nothing but benchmarks and cherry picked examples, I would not be so quick to believe GPT-4V has been bested. PALM-2 was generally useless and plagued by hallucinations in my experience with Bard. It’ll be several months till Gemini Pro is even available. We also don’t know basic facts like the number of parameters or training set…
Pro is available now - Ultra will take a few months to arrive.
Re: Gemini AI
#669E.g. In a similar vein within Silicon Chip. The same move that Qualcomm tried to do with Snapdragon 8cx Gen 4 over M2. Then 1 week later, Apple came out with M3. And at least with processors, they seem to me marginal, and the launch cadence from these companies just gets us glued to the news, when in fact they have performance spec'ed out 5 years from now, and theoretically ready to launch.
Re: Gemini AI
#670Earlier quoted context omitted.
I think it’s so strange how Pro wasn’t launched for Bard in Europe yet. I thought Bard was already cleared for EU use following their lengthy delay, and that this clearance wouldn’t be a recurring issue to overcome for each new underlying language model. Unless it’s technically hard to NOT train it on your data or whatever. Weird.
I suspect this is because inference is very expensive (much like GPT-4) and their expected ARPU (average revenue per user) in Europe is just not high enough to be worth the cost. See disposable income per capita (in PPP dollars): https://en.m.wikipedia.org/wiki/Disposable_household_and_per...