It's funny the page says BLUE score instead of BLEU score.
I bet it started off as BLEU and then during the editing process it got 'corrected' to BLUE.
Gemini AI
21–30 of 1001 posts
Re: Gemini AI
#22> For Gemini Ultra, we’re currently completing extensive trust and safety checks, including red-teaming by trusted external parties, and further refining the model using fine-tuning and reinforcement learning from human feedback (RLHF) before making it broadly available. > As part of this process, we’ll make Gemini Ultra available to select customers, developers, partners and safety and responsibility experts for ear…
>Finally, some competition for GPT4 API!!! This is such good news. Save your enthusiasm for after it launches; Google's got a habit of over-promising when it comes to AI.
Everything they published thus far in the generative AI space has been abysmal in quality compared to the competition. I'd be hella surprised if this reaches GPT-4 levels of quality...
Re: Gemini AI
#23Anywhere to actually run this?
[deleted]
Re: Gemini AI
#24[deleted]
Re: Gemini AI
#25Gemini can become a major force with 7% increase in code-writing capability when GPT-4 is getting lazy about writing code these days.
Better OCR with 4% difference, better international ASR, 10% decrease.
Seeing Demis Hassabis name in the announcement makes you think they really trust this one.
Re: Gemini AI
#26Feels more like an Apple post "the best fastest blabla-est". How about making it available to try without the fluff?
The articles seems to report some data points which at least make it seem comparable to GPT4. To me, I feel as though this makes it more objective vs fluff.
Re: Gemini AI
#27The improvement over ChatGPT are counted in (very) few percents. Does it mean they have entered a diminishing returns phase or is it that each percent is much harder to get compared to the previous ones ?
Re: Gemini AI
#28It's truly astounding to me that Google, a juggernaut with decades under its belt on all things AI, is only now catching up to OpenAI which is on all camps a fraction of its size.
Re: Gemini AI
#29The performance results here are interesting. G-Ultra seems to meet or exceed GPT4V on all text benchmark tasks with the exception of Hellaswag where there's a significant lag, 87.8% vs 95.3%, respectively.
Re: Gemini AI
#30AI arms race has begun!