Google should just offer llama3 405b, maybe slightly fine tuned. Geminis are unusable.
> Geminis are unusable
how so?
Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
81–90 of 151 posts
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#82This sounds interesting: "We will continue to offer a suite of safety filters that developers may apply to Google’s models. For the models released today, the filters will not be applied by default so that developers can determine the configuration best suited for their use case."
This is the most important update. Pricing and speed doesn't matter when your call fails because of "safety".
Also Google's safety filters are absolutely awful. Beyond parody levels of bad.
This is a query I did recently that got rejected for "safety" reasons:
Who are the current NFL starting QBs?
Controversial I know, I'm surprised I'd be willing to take the risk with submitting such a dangerous query to the model.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#83Google should just offer llama3 405b, maybe slightly fine tuned. Geminis are unusable.
Pretty sure Google's got more than 700 million active users.
In fact, Google is most likely _the_ target for that clause in the license.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#84Earlier quoted context omitted.
I wonder if they're pulling the wall-mart model. Ruthlessly cut costs and sell at-or-below costs until your competitors go out of business, then ratchet up the prices once you have market dominance.
Probably not. Do they really believe they are going to knock OpenAI out of business, when the OpenAI models are better? Instead I think they are going after the "Android model". Recognize they might not be able to dethrone the leader who invented the space. Define yourself in the marketplace as the cheaper alternative. "Less good but almost as good." In the end, they hope to be one of a small number of surviving memb…
Android is more popular than iOS by a large margin and it's neither less good or cheaper, it really depends on the smartphone.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#85Earlier quoted context omitted.
I wonder if they're pulling the wall-mart model. Ruthlessly cut costs and sell at-or-below costs until your competitors go out of business, then ratchet up the prices once you have market dominance.
Probably not. Do they really believe they are going to knock OpenAI out of business, when the OpenAI models are better? Instead I think they are going after the "Android model". Recognize they might not be able to dethrone the leader who invented the space. Define yourself in the marketplace as the cheaper alternative. "Less good but almost as good." In the end, they hope to be one of a small number of surviving memb…
The latest Google Pixel phone (you know, the one that Google actually set the price for) appears to cost the exact same as the latest iPhone ($999 for pro, $799 for non-pro). And I would argue against the "less good" bit too.
I think this analysis is not in keeping with reality, and I doubt if that's their strategy.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#86Has anyone used Gemini Code Assist? I'm curious how it compares with Github Copilot and Cursor.
I know you aren't necessarily talking about in-editor code assist but something about in-editor AI cloud code assist makes me super uncomfortable.
It makes sense I need to be careful not to commit secrets to public repositories but now I have to avoid not only saving credentials into a file but even to paste them by accident into my editor?
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#87Earlier quoted context omitted.
I wonder if they're pulling the wall-mart model. Ruthlessly cut costs and sell at-or-below costs until your competitors go out of business, then ratchet up the prices once you have market dominance.
Probably not. Do they really believe they are going to knock OpenAI out of business, when the OpenAI models are better? Instead I think they are going after the "Android model". Recognize they might not be able to dethrone the leader who invented the space. Define yourself in the marketplace as the cheaper alternative. "Less good but almost as good." In the end, they hope to be one of a small number of surviving memb…
Cheapness has a quality all its own.
Gemini is substantially cheaper to run (in consumer prices, and likely internally as well) than OpenAI's models. You might wonder, what's the value in this, if the model isn't leading? But cheaper inference could potentially be a killer edge when you can scale test-time compute for reasoning. Scaling test-time compute is, after all, what makes o1 so powerful. And this new Gemini doesn't expose that capability at all to the user, so it's comparing apples and oranges anyway.
DeepMind researchers have never been primarily about LLMs, but RL. If DM's (and OAI's) theory is correct--that you can use test-time compute to generate better results, and train on that--this is potentially a substantial edge for Google.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#88Earlier quoted context omitted.
Probably not. Do they really believe they are going to knock OpenAI out of business, when the OpenAI models are better? Instead I think they are going after the "Android model". Recognize they might not be able to dethrone the leader who invented the space. Define yourself in the marketplace as the cheaper alternative. "Less good but almost as good." In the end, they hope to be one of a small number of surviving memb…
The latest Google Pixel phone (you know, the one that Google actually set the price for) appears to cost the exact same as the latest iPhone ($999 for pro, $799 for non-pro). And I would argue against the "less good" bit too. I think this analysis is not in keeping with reality, and I doubt if that's their strategy.
I doubt anyone buys Pixel phones at full price. They are discounted almost right out of the gate.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#89Google should just offer llama3 405b, maybe slightly fine tuned. Geminis are unusable.
I've found Gemini Pro to be the most reliable for function calling.
Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more
#90Has anyone used Gemini Code Assist? I'm curious how it compares with Github Copilot and Cursor.
I use it and find it very helpful. Never tried cursor or copilot though
I tried Cursor the other day. It was actually pretty cool. My thought was, I'll open this open source project and use it to grok my way around the codebase. It was very helpful. After that I accidentally pasted an API secret into the document; had to consider it compromised and re-issued the credential.