Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude vs. Gemini: Testing on 1M Tokens of Context

every.to

Post reply on HN
Print view View original

31–40 of 49 posts

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#31

Post by HackerThemAll »

matesz wrote: post #27
HackerThemAll wrote: post #23

What people seem to miss very hard is that they get interactive chat mode of all the models, including the best and newest (Gemini 2.5 Pro, 2.5 Flash, 2.5 Flash Lite and older) totally for free. I mean when working from chat at https://aistudio.google.com/ the entire 1M context window and all is totally free of charge. You really get a very good AI for nothing. https://i.imgur.com/pgfRrZY.png

Geminis free tier allows maybe 5 messages on average, for 2.5 pro at least and this is not usable. I’m using Claude Pro for daily driver and Gemini / ChatGPT free tiers.

You are clearly confirming my comment above.

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#33

Post by magicalhippo »

PeterStuer wrote: post #17
koakuma-chan wrote: post #8

I really doubt you can fit all Harry Potter books in 1M tokens.

The series is 1,084,170 words. At let's say 1.4 tokens per word, this would not fit, but it is getting close.

How do they do if you test[1] them for attention deficit disorder?

[1]: https://www.imdb.com/title/tt0766092/quotes/?item=qt1440870

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#35

Post by netdur »

irthomasthomas wrote: post #5

So sonnet-4 is faster than gemini-2.5-flash at long context. That is surprising. Especially since Gemini runs on those fast TPUS.

output tokens must be generated in order (autoregressive decoding), inputs don’t have that constraint, so prefill is parallel, with stronger kernels, KV-cache handling, and batching, Claude can outrun Gemini.

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#36

Post by kridsdale3 »

koakuma-chan wrote: post #14
gcr wrote: post #10

Earlier quoted context omitted.

The entire HP series is about one million words.

Harry Potter and the Order of Phoenix alone is 400K tokens.

And takes up a proportional width of everyone's bookshelves along side the others.

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#37

Post by thomastjeffery »

HackerThemAll wrote: post #31
matesz wrote: post #27

Earlier quoted context omitted.

Geminis free tier allows maybe 5 messages on average, for 2.5 pro at least and this is not usable. I’m using Claude Pro for daily driver and Gemini / ChatGPT free tiers.

You are clearly confirming my comment above.

How?

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#39

Post by koakuma-chan »

chrismustcode wrote: post #30
koakuma-chan wrote: post #21

Earlier quoted context omitted.

It's 2M tokens for Gemini.

That was previous iterations, 2.5 is 1 million context window https://ai.google.dev/gemini-api/docs/models (context window is details under model variant section with + signs) They were meant to crank 2.5 to 2 million at some point though, maybe waiting now till 3?

I mean the Harry Potter books are 2M tokens.

Re: Claude vs. Gemini: Testing on 1M Tokens of Context

#40

Post by 7thpower »

HackerThemAll wrote: post #23

What people seem to miss very hard is that they get interactive chat mode of all the models, including the best and newest (Gemini 2.5 Pro, 2.5 Flash, 2.5 Flash Lite and older) totally for free. I mean when working from chat at https://aistudio.google.com/ the entire 1M context window and all is totally free of charge. You really get a very good AI for nothing. https://i.imgur.com/pgfRrZY.png

Funny you mention this, I literally just got done loading the context window of AI studio up for an hour doing some prototyping and then was frustrated when I couldn’t see where I was at from billing (knew it couldn’t be that much, but I still like to know).

I assumed because I’m on paid tiers it would still cost behind a certain usage amount, but I guess not.

Post reply on HN