Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.
> "ChatGPT has already replaced Google for me" Would you mind elaborating more on this. Like how are you "searching" with ChatGPT?
I use Kagi’s AI stuff for search all the time. Just type in a question and add !fast… it’ll search the web, write a response based on what it finds, and gives you the links. It’s not perfect, but it’s at least as good as Bing with much less annoying UX.
He's not wrong. DeepMind spends time solving big scientific / large-scale problems such as those in genetics, material science or weather forecasting, and Google has untouchable resources such as all the books they've scanned (and already won court cases about) They do make OpenAI look like kids in that regard. There is far more to technology than public facing goods/products. It's probably in part due to the cultura…
Great. But school's out. It's time to build product. Let the rubber hit the road. Put up or shut up, as they say. I'm not dumb enough to bet against Google. They appear to be losing the race, but they can easily catch up to the lead pack. There's a secondary issue that I don't like Google , and I want them to lose the race. So that will color my commentary and slow my early adoption of their new products, but unless…
To add to my comment above: Google DeepMind put out 16 videos about Gemini today, the total watch time at 1x speed is about 45 mins. I've now watched them all (at >1x speed). In my opinion, the best ones are: * https://www.youtube.com/watch?v=UIZAiXYceBI - variety of video/sight capabilities * https://www.youtube.com/watch?v=JPwU1FNhMOA - understanding direction of light and plants * https://www.youtube.com/watch?v=D…
Some people on codeforces (the competitive programming platform that this was tested on) are discussing the model: https://codeforces.com/blog/entry/123035 Seems like they don't believe that it solved the 3200 rated problem ( https://codeforces.com/contest/1810/problem/G ) w/o data leakage For context, there are only around 20 humans above 3200 rating in the world. During the contest, there were only 21 successful su…
It doesn't code like human so you would expect it to be better at some kinds of tasks. It brute forces the problems by generating a million solutions and then tries to trim that down, a few problems might be vulnerable to that style of approach.
Why do they gate access at country level if it's about language. I live in Europe and speak English just fine. Can't they just offer it in English only until the multi-language support is ready?
Launching anything as a big tech company in Europe is an absolute nightmare. Between GDPR, DSA, DMA and in Google's case, several EC remedies, it takes months to years to get anything launched.
It's only a nightmare if you are an adtech company whose revenue relies on tracking users, and have a history of violating their privacy.
One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
That was pretty impressive… but do I have to be “that guy” and point out the error it made? It said rubber ducks float because they’re made of a material less dense than water — but that’s not true! Rubber is more dense than water. The ducky floats because it’s filled with air. If you fill it with water it’ll sink. Interestingly, ChatGPT 3.5 makes the same error, but GPT 4 nails it and explains the it’s the air that…
I spotted that too, but also, it didn't recognise the "bird" until it had feet, when it is supposedly better than a human expert. I don't doubt that the examples were cherry-picked, so if this is the best it can do, it's not very convincing.
Agreed. The whole things reeks of being desperate. Half the video is jerking themselves off that they've done AI longer than anyone and they "release" (not actually available in most countries) a model that is only marginally better than the current GPT4 in cherry-picked metrics after nearly a year of lead-time?!?! That's your response? Ouch.
I’m impressed that it’s multimodal and includes audio. GPT-4V doesn’t include audio afaik. Also I guess I don’t see it as critical that it’s a big leap. It’s more like “That’s a nice model you came up with, you must have worked real hard on it. Oh look, my team can do that too.” Good for recruiting too. You can work on world class AI at an org that is stable and reliable.
One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…
I also find that tone a bit annoying but I'm OK with it because it highlights how these types of bets, without an immediate benefit, can pay off very well in the long term, even for huge companies like Google. AI, as we currently know it, wasn't really a "thing" when Google started with it and the payoff wasn't clear. They've long had to defend their use of their own money for big R&D bets like this and only now is i…
This announcement makes we wonder if we are approaching a plateau in these systems. They are essentially claiming close to parity with gpt-4, not a spectacular new breakthrough. If I had something significantly better in the works, I'd either release it or hold my fire until it was ready. I wouldn't let openai drive my decision making, which is what this looks like from my perspective. Their top line claim is they ar…
In my opinion the field is not that rapidly advancing. The major breakthroughs, where something was really much better than everything before were the following: GPT-2 February 2019 GPT-3 June 2020 CPT-3.5 December 2022 GPT-4 February 2023 Note that GPT-3 to GPT4 took almost 3 years!
That seems like a pretty remarkable pace of innovation, no?
For others that were confused by the Gemini versions: the main one being discussed is Gemini Ultra (which is claimed to beat GPT-4). The one available through Bard is Gemini Pro . For the differences, looking at the technical report [1] on selected benchmarks, rounded score in %: Dataset | Gemini Ultra | Gemini Pro | GPT-4 MMLU | 90 | 79 | 87 BIG-Bench-Hard | 84 | 75 | 83 HellaSwag | 88 | 85 | 95 Natural2Code | 75 |…
the numbers are not at all comparable, because Gemini uses 34 shot and variable shot vs 5 for gpt 4. this is very deceptive of them.