171–180 of 616 posts
Earlier quoted context omitted.
I am growing tired of these pelicans posts every time a new model is published. Feels to me like low effort personal brand promotion. Just sharing my 2 cents.
A new model arrives. The pelican, with uncanny commercial instinct, is never far behind. Sponsored blogs and paid newsletters are after all, notoriously poor at subsisting on silence :)
It's scary relying on Google's models. I have a very price sensitive workload that used to run on flash 2.5 lite - it's deprecated now. The replacement 3.1 flash lite is a lot more expensive, but now also has a sunset date. 3.5 flash lite is even more expensive. So the price is rising and you have no choice but to keep paying more and more.
> So the price is rising and you have no choice but to keep paying more and more. I presume you can't use deepseek?
I deeply wish Google would focus on models like Gemma. Small, powerful, open-weight models you can run on phones or regular computer hardware.
Pelicans for 3.6 Flash and 3.5 Flash-Lite (Cyber isn't available to me through the API yet.) https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
I am growing tired of these pelicans posts every time a new model is published. Feels to me like low effort personal brand promotion. Just sharing my 2 cents.
All of the pelicans so far have had really weird flaws / quirks so I am always a little interested to see how well these models perform at this task, since I've seen all the past pelicans and have some anchoring.
Seeing a truly flawless pelican would tell me that the model has true visual reasoning capabilities as well as good taste.
Plus they are probably running these things on every Google search so saving tokens is a huge win for them.
Earlier quoted context omitted.
Anything Sam Rose is worth reading: https://ngrok.com/blog/prompt-caching but the implementation will be up to your provider and harness, for deepseek, they expose some numbers: https://api-docs.deepseek.com/guides/kv_cache/ and Anthropic has a list of actions invalidating your cache: https://platform.claude.com/docs/en/build-with-claude/prompt... Basically, you avoid anything dynamic: model change, tool change, etc…
I just put the varying parameters in a trailer prompt and have them change every time. It doesn’t matter because the cache is prefix keyed. You lose caching for the last 20 tokens or so but that’s not a big deal. Moving it to a tool call makes it too slow (needs full roundtrip). If you’re constructing the prompt you don’t have to jam everything together you can arrange it appropriately.
Pelicans for 3.6 Flash and 3.5 Flash-Lite (Cyber isn't available to me through the API yet.) https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
Pelicans for 3.6 Flash and 3.5 Flash-Lite (Cyber isn't available to me through the API yet.) https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
I am growing tired of these pelicans posts every time a new model is published. Feels to me like low effort personal brand promotion. Just sharing my 2 cents.
Google somehow managed to snatch defeat from the jaws of success with their AI products. They literally forced me and my company out of Antigravity by phasing out AI Ultra subscription without any proper product follow-up. Antigravity IDE cannot even have poweruser subscriptions now from Google Workspace an Gemini Enterprise Agent Platform cannot be attached to Antigravity IDE. Gemini Enterprise Agent Platform has an…