Viewing profile — martinald

Also looks incredibly fast. 150tps on openrouter (nearly all deepseek providers are around the 50tps mark).

It depends. If you are doing blog content with the idea of upselling users to your product, probably not as much (because the LLM can just give the user the answer). However, if yo…

That's not _entirely_ true. Search Console now has a Generative AI page where you can see impressions per page now. Bing has something similar. Also, I would assume that really "GE…

It's interesting to me when I go to the cinema how poor the quality is compared to at home on an OLED TV. The blacks are so grey and dark stuff is hard to make out.The resolution i…

now failing for me, esp auto mode classification

I don't think so. According to some very basic research there are around 8bn searches a day, or 250bn a month. Let's assume Google serves AI overviews on every SERP (they don't) an…

If it is marketing it's the most silly marketing of all time. They are under extreme pressure from the US Govt to prove safety and saying "our model escaped" is not ideal. Perhaps …

Yes agreed - I wrote this up a while back https://martinalderson.com/posts/whats-going-on-with-gemini/ My view then was they are optimising the models for inference ability on thei…

Will be interesting to see how it stacks up pricing wise on the various inference providers.

GPUs are even more extreme. A 5060 is something like 15,000x faster than a 3dfx Voodoo card from ~2000 by my limited research.

MCP makes a lot, lot more sense when you think of it as as a auth standard and not a comparison with CLIs. It obviously does more than just auth, but having standardised auth (whic…

I don't think that's inevitable with RL. Imagine in C# you are training the model with RL loops in a harness. One uses C#12 and one uses C#15 (when released), with union types (and…

Micron said that they tried to tell 2 of their largest customers (one almost certainly Apple) that the prices they were demanding would result in the cancellation of a lot new cons…

Really sad. I grew up reading his writing. I emailed him some thoughts on one of his blog and he immediately replied in a lovely way very recently. What a shock and a loss.

Why not? It's the first time many developing countries have had access to high quality internet at an often relatively affordable price?

Well, the EU insists that track & train operations are separate. (ironically the UK _is_ combining passenger operations and track somewhat back together, which is only possible bec…

Wrote this a while back. https://martinalderson.com/posts/no-it-doesnt-cost-anthropic... OpenRouter is the best guide to real costs.

Yes agreed, for example, there was an interesting table on the starlink page I used to check every so often showing which countries had access to starlink as it was rolled out. Was…

The point is that tok/s/GPU stays ~roughly stable. So you need say 4 GB200s minimum to fit the modules, but this provides 4x the tok/s as 1 GPU.