The hands-on demo is pretty cool. Need this on phone asap. https://www.youtube.com/watch?v=UIZAiXYceBI
Gemini AI
711–720 of 1001 posts
Re: Gemini AI
#712Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…
Re: Gemini AI
#713Earlier quoted context omitted.
He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…
While you are spot on, I cannot avoid thinking of 1996 or so. On one corner: IBM Deep Blue winning vs Kasparov. A world class giant with huge research experience. On the other corner, Google, a feisty newcomer, 2 years in their life, leveraging the tech to actually make something practical. Is Google the new IBM?
Re: Gemini AI
#714To me it doesn't look impressive at all. In this video: https://www.youtube.com/watch?v=LvGmVmHv69s , Google talked about solving a competitive programming problem using dynamic programming. But DP is considered only an intermediate level technique in National Olympiad in Informatics/USACO level competitions, which are targeted at secondary school students. For more advanced contests the tough questions usually requi…
Re: Gemini AI
#715One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
I find this video really freaky. It’s like Gemini is a baby or very young child and also a massively know it all adult that just can’t help telling how clever it is and showing off its knowledge. People speak of the uncanny valley in terms of appearance. I am getting this from Gemini. It’s sort of impressive but feels freaky at the same time. Is it just me?
It is a great example of what I've been finding a growing concern as we double down on Goodhart's Law with the "beats 30 out of 32 tests compared to existing models."
My guess is those tests are very specific to evaluations of what we've historically imagined AI to be good at vs comprehensive tests of human ability and competencies.
So a broad general pretrained model might actually be great at sounding 'human' but not as good at logic puzzles, so you hit it with extensive fine tuning aimed at improving test scores on logic but no longer target "sounding human" and you end up with a model that is extremely good at what you targeted as measurements but sounds like a creepy toddler.
We really need to stop being so afraid of anthropomorphic evaluation of LLMs. Even if the underlying processes shouldn't be anthropomorphized, the expressed results really should be given the whole point was modeling and predicting anthropomorphic training data.
"Don't sound like a creepy soulless toddler and sound more like a fellow human" is a perfectly appropriate goal for an enterprise scale LLM, and we shouldn't be afraid of openly setting that as a goal.
Re: Gemini AI
#716Earlier quoted context omitted.
Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.
> "ChatGPT has already replaced Google for me" Would you mind elaborating more on this. Like how are you "searching" with ChatGPT?
Re: Gemini AI
#717Earlier quoted context omitted.
He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…
> They do make OpenAI look like kids in that regard. Nokia and Blackberry had far more phone-making experience than Apple when the iPhone launched. But if you can't bring that experience to bear, allowing you to make a better product - then you don't have a better product.
Re: Gemini AI
#718One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…
Re: Gemini AI
#719One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…
Re: Gemini AI
#720One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
That was pretty impressive… but do I have to be “that guy” and point out the error it made? It said rubber ducks float because they’re made of a material less dense than water — but that’s not true! Rubber is more dense than water. The ducky floats because it’s filled with air. If you fill it with water it’ll sink. Interestingly, ChatGPT 3.5 makes the same error, but GPT 4 nails it and explains the it’s the air that…