Viewing profile — samuelknight

They haven't revealed what they are changing in the price, but it's probably cache hit prices. They subsidized theirs to 10x less than normal to drive adoption. That's almost certa…

I don't like to complain but I have spent a lot of time learning about how to build a diet and I have never seen an article so bad in such a short amount of space. > ... new federa…

You can't come up with a counterexample for P != NP because there isn't a formula to disprove. For P = NP you would propose a general algorithm to convert all NP problems into P in…

It has some weird side effects though. for example KV-caches are implemented in fixed incremental token blocks (1024 from the providers I used) instead of simply caching up to the …

Going by the chart in the article, if your total workload is 1k cataloged items and your quality threshold is 70%, why wouldn't you just pay $19 to gemini API instead of $500 + tim…

Amazon (or at least AWS as I knew it) did this a lot. Multiple redundant efforts accumulate and silo under different leaders. Eventually a VP picks a winner and everyone else re-or…

Phi was cool for what it was. But it's not 2024 anymore.

Not useless. LLMs are the most general purpose computer algorithms ever created. They are getting smarter and cheaper at a geometric rate. What is a bad idea today could have usefu…

Has the author used an LLM to brainstorm architecture, explore trade-offs, challenge assumptions, or refine a design? Models are not just 'a data distiller'. "How could I implement…

Programs are tightly shaped to their dependencies and software frequently breaks when bumping a dependency versions. That's why we have package managers that are carefully built ar…

It's not a smell. Why should these developers rebuild a core piece of their stack every few months. Switching out a model requires a new round of testing and validation when we sho…

There is an issue on the page that causes the benchmark tables to get cut off. If you highlight and drag right you can see a few more models like Gemini and Claude Opus. It's also …

This is the bind of an arms race. Any lab that tries to pump the breaks quickly becomes second rate. Regulatory capture doesn't work either because the technology crosses jurisdict…

You can create an index on an expires_at column and opportunistically DELETE on each write to the cache table.

Inference has been decreasing in cost by about 10x per year since 2023.

My startup develops self-serve pentesting tool. https://vulnetic.ai/

> replacing BANG with the title of _a_ video on this channel. The agent has knowledge of private videos, so the proof of concept causes it to construct a URL that sends one video i…

The first day Fable was released I tried to get it to summarize it's own announcement on the Anthropic blog and it dropped to Opus. On top of being very expensive you pay for the r…

The Reddit poster called it spyware which is not right. They are using stenography to fingerprint accounts using Claude Code instances routing through Chinese resellers.

It will be much harder for Chinese models to close the gap than it is to keep the historical 6-9 months behind. Their models' performance are heavily propped up on distillation run…

Buying all the RAM can't work forever. Scarcity increases prices, high prices increase supply, improves RAM R&D budgets, and forces users to find ways to economize around low RAM a…

I didn't connect the reseller pricing to DS and GLM prices until you explained it. Very good observation. Deepseek v4 pro in particular is priced so low that it's hard to imagine t…

If it has steps to reproduce, you give it to your coding agent to "fix [bug] using TDD". If it can't make a test it wasn't reproducible.

A reviewer can only test the model they have access too. They should not speculate about what the model could have done without provider tampering. I think Anthropic's mistake here…