Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

developers.googleblog.com

Post reply on HN
Print view View original

51–60 of 151 posts

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#51

Post by spiralk »

kendallchuang wrote: post #49
spiralk wrote: post #32

Earlier quoted context omitted.

The Aider leaderboards seem like a good practical test of coding usefulness: https://aider.chat/docs/leaderboards/ . I haven't tried Cursor personally but I am finding Aider with Sonnet more useful that Github Copilot and its nice to be able to pick any model API. Eventually even a local model may be viable. This new Gemini model does not rank very high unfortunately.

Thanks for the link. That's unfortunate, though perhaps the benchmarks will be updated after this latest Gemini release. Cursor with Sonnet is great, I'll have to give Aider a try as well.

It is updated actually, gemini-1.5-pro-002 is this new model.

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#52

Post by tiborsaas »

stan_kirdey wrote: post #37

Google should just offer llama3 405b, maybe slightly fine tuned. Geminis are unusable.

AI companies should not pick up naming models after astrological signs, after a while it will be hard to tell apart model reviews from horoscope.

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#53

Post by ldjkfkdsjnv »

jzebedee wrote: post #34

As someone who actually had to build on Gemini, it was so indefensibly broken that I couldn't believe Google really went to production with it. Model performance changes from day to day and production is completely unstable as Google will randomly decide to tweak things like safety filtering with no notice. It's also just plain buggy, as the agent scaffolding on top of Gemini will randomly fail or break their own int…

The engineers at google are bad, they keep hiring via pure leetcode. Cant ship working products

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#55

Post by [deleted] »

jzebedee wrote: post #34

As someone who actually had to build on Gemini, it was so indefensibly broken that I couldn't believe Google really went to production with it. Model performance changes from day to day and production is completely unstable as Google will randomly decide to tweak things like safety filtering with no notice. It's also just plain buggy, as the agent scaffolding on top of Gemini will randomly fail or break their own int…

[deleted]

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#57

Post by ldjkfkdsjnv »

They have to drop the price because the model is bad. People will pay almost any cost for a model that is much better than the rest. How this company carries on the facade of competence is laughable. All the money on the planet, and they still cannot win on their core "competency".

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#58

Post by FergusArgyll »

Any opinions on pro-002 vs pro-exp-0827 ?

Unlike others here I really appreciate the gemini API, it's free and it works. I haven't done too many complicated things with it but I made a chatbot for the terminal, a forecasting agent (for metaculus challenge) and a yt-dlp auto namer of songs. The point for me isn't really how it compares to openAI/anthropic, it's a free API key and I wouldn't have made the above if I had to pay just to play around

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#59

Post by throwup238 »

Workaccount2 wrote: post #50
xendipity wrote: post #36

Earlier quoted context omitted.

Ooh, what are these ASICs you're talking about? My understanding was that we'll see AMD/Nvidia gpus continue to be pushed and very competitive as well as have new system architectures like cerebras or grok. I haven't heard about new compute platforms framed as ASICs.

Cerebras has ridiculously large LLM ASICs that can hit crazy speeds. You can try it with llama 8B and 70B: https://inference.cerebras.ai/ It's pretty fast, but my understanding is that it is still too expensive even accounting for the speed-up.

Is Cerebras an integrated circuit or more an integrated wafer? :-)

And yeah their cost is ridiculous, on the order for high 6 to low 7 figures per wafer. The rack alone looks several times more expensive than the 8x NVIDIA pods [1]

[1] https://web.archive.org/web/20230812020202/https://www.youtu...

Re: Two new Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

#60

Post by 999900000999 »

phren0logy wrote: post #40
999900000999 wrote: post #28

Earlier quoted context omitted.

Not sure why your getting down voted. Anything sent to an cloud hosted LLM is subject to be publicly released or used in training. Setting up a local LLM isn't that hard, although I'd probably air gap anything truly sensitive. I like ollama, but it wouldn't surprise me if it's phoning home.

This is just incorrect. The OpenAI models hosted though Azure are HIPAA-compliant, and Antropic will also sign a BAA.

I'm open to being wrong. However for many industries your still running the risk of leaking data via a 3rd party service.

You can run Llama3 on prem, which eliminates that risk. I try to reduce reliance on 3rd party services when possible. I still have PTSD from Saucelabs constantly going down and my manager berating me over it.

Post reply on HN