131–140 of 285 posts
That 1M tokens context window alone is going to kill a lot of RAG use cases. Crazy to see how we went from 4K tokens context windows (2023 ChatGPT-3.5) to 1M in less than 2 years.
I'd say it makes sense to do RAG even if your stuff fits into context comfortably.
Benchmarks or it didn't happen. Anything better than https://lmarena.ai/?leaderboard ? My experience with the Gemini 1.5 models has been positive. I think Google has caught up.
- https://aider.chat/docs/leaderboards/
- https://www.prollm.ai/leaderboard
Earlier quoted context omitted.
Indeed, you can facilitate talking politics without having a set opinion. It's a fine line, but it is something the BBC managed to do for a very long time. The BBC does not itself present an opinion on Politics yet facilitates political discussion through shows like Newsnight and The Daily Politics (rip).
BBC is great at talking about the Gaza situation. Makes it seem like people are just dying from natural causes all the time.
That 1M tokens context window alone is going to kill a lot of RAG use cases. Crazy to see how we went from 4K tokens context windows (2023 ChatGPT-3.5) to 1M in less than 2 years.
That's not really my experience. Error rate goes up the more stuff you cram into the context, and processing gets both slower and more expensive with the amount of input tokens. I'd say it makes sense to do RAG even if your stuff fits into context comfortably.
What is the model I get at gemini.google.com (i.e. through my Workspace subscription)? It says "Gemini Advanced" but there are no other details. No model selection option. I find the lack of clarity very frustrating. If I want to try Google's "best" model, should I be purchasing something? AI Studio seems focused around building an LLM wrapper app, but I just want something to answer my questions. Edit: what I've lea…
changes must be rolling out now, I can see 3 Gemini 2.0 models in the dropdown, with blue "new" badges. screenshot: https://beeimg.com/images/g25051981724.png
Earlier quoted context omitted.
This works on my personal Google account, but not on my workspace one. So I guess there's no access to 2.0 Pro then? I'm ok trying out Flash for now and see if it fixes the mistakes I ran into yesterday. Edit: it does not. It continues to miss the fact that I'm (incorrectly) passing in a scaled query tensor to scaled_dot_product_attention. o3-mini-high gets this right.
As someone with over a decade of Google Apps management history, my experiences is Workspace customers are practically always the last to get the shiny new features. Quite frustrating.
Earlier quoted context omitted.
They actually have two "studios" Google AI Studio and Google Cloud Vertex AI Studio And both have their own documentation, different ways of "tuning" the model. Talk about shipping the org chart.
> Talk about shipping the org chart. Good expression. I’ve been thinking about a way to say exactly this.
I tried voice chat. It's very good, except for the politics We started talking about my plans for the day, and I said I was making chili. G asked if I have a recipe or if I needed one. I said, I started with Obama's recipe many years ago and have worked on it from there. G gave me a form response that it can't talk politics. Oh, I'm not talking politics, I'm talking chili. G then repeated form response and tried to c…