There are plenty of smart people I know personally at Google and DeepMind that will get this right. Google has 100X more data (data=food for neural networks) than OpenAI, It has youtube, Google Photos, Emails and search histories. There is a lot more pressure on Google than OpenAI to release Safe models, that is why this models are getting delayed, In my opinion they should go ahead and release it by phases to stop all this non sense speculation. We all want competition and I hope Google model will be a good one and free and can lift society forward and more prosperous and productive for everyone.
Gemini AI
821–830 of 1001 posts
Re: Gemini AI
#822Earlier quoted context omitted.
Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.
> "ChatGPT has already replaced Google for me" Would you mind elaborating more on this. Like how are you "searching" with ChatGPT?
I ask quick coding questions exclusively to chatgpt. it's extremely direct and quick compared to stackoverflow (or god forbid any other website with 3 pages of someone's life story first) and if i paste in the segment of code im working on it'll even show me with my own code.
Re: Gemini AI
#823There are plenty of smart people I know personally at Google and DeepMind that will get this right. Google has 100X more data (data=food for neural networks) than OpenAI, It has youtube, Google Photos, Emails and search histories. There is a lot more pressure on Google than OpenAI to release Safe models, that is why this models are getting delayed, In my opinion they should go ahead and release it by phases to stop a…
I hope founders will come back, Larry or Sergay to the leadership positions and make company more innovative as before.
Re: Gemini AI
#824Earlier quoted context omitted.
The table is *highly* misleading. It uses different methodologies all over the place. For MMLU, it highlights the CoT @ 32 result, where Ultra beats GPT4, but it loses to GPT4 with 5-shot, for example. For GSM8K it uses Maj1@32 for Ultra and 5-shot CoT for GPT4, etc. Then also, for some reason, it uses different metrics for Ultra and Pro, making them hard to compare. What a mess of a "paper".
Why is that misleading? It shows Gemini with CoT is the best known combination of prompt and LLM on MMLU. They simply compare the prompting strategies that work best with each model. Otherwise it would be just a comparison of their response to specific prompt engineering.
> They simply compare the prompting strategies that work best with each model
Incorrect.
# Gemini marketing website, MMLU
- Gemini Ultra 90.0% with CoT@32*
- GPT-4 86.4% with 5-shot* (reported)
# gemini_1_report.pdf, MMLU
- Gemini Ultra 90.0% with CoT@32*
- Gemini Ultra 83.7% with 5-shot
- GPT-4 87.29% with CoT@32 (via API*)
- GPT-4 86.4% with 5-shot (reported)
Gemini marketing website compared best Gemini Ultra prompting strategy with a worse-performing (5-shot) GPT-4 prompting strategy.
Re: Gemini AI
#825Earlier quoted context omitted.
To add to my comment above: Google DeepMind put out 16 videos about Gemini today, the total watch time at 1x speed is about 45 mins. I've now watched them all (at >1x speed). In my opinion, the best ones are: * https://www.youtube.com/watch?v=UIZAiXYceBI - variety of video/sight capabilities * https://www.youtube.com/watch?v=JPwU1FNhMOA - understanding direction of light and plants * https://www.youtube.com/watch?v=D…
When I watch any of these videos, all the related videos on my right sidebar are from Google, 16 of which were uploaded at the same time as the one I'm watching. I've never seen the entire sidebar filled with the videos of a single channel before.
Yeah. Dropping that blatant a weight on the algorithm is the most infuriating dark patterns I've noticed in a while.
Re: Gemini AI
#826Looks very ahead. Seems like OpenAI days are numbered.
Re: Gemini AI
#827great, but, where can I use it? bard seems still the same, and, is there a chat.gemini.ai site I can use? otherwise, it's just a PR for now.
Re: Gemini AI
#828Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…
This is something that always bugs me about Google, bragging about something you can't even use. Waymo was like this for a while, then it actually came into existence but only in two cities as a beta run.
Re: Gemini AI
#829Earlier quoted context omitted.
How real is it though? This blog post says In this post, we’ll explore some of the prompting approaches we used in our Hands on with Gemini demo video. which makes it sound like they used text + image prompts and then acted them out in the video, as opposed to Gemini interpreting the video directly. https://developers.googleblog.com/2023/12/how-its-made-gemin...
After reading this blog post, that hands-on video is just straight-up lying to people. For the boxcar example, the narrator in the video says to Gemini: > Narrator: "Based on their design, which of these would go faster?" Without even specifying that those are cars! That was impressive to me, that it recognized the cars are going downhill _and_ could infer that in such a situation, aerodynamics matters. But the blog…
Those prompts aren't far off, but I still don't know how realistic the demo is. Until a product is in my hands, as far as I'm concerned it doesn't exist.
Re: Gemini AI
#830Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…
[deleted]