Is this the beginning of the Hyperion TechnoCore?
Sakana Fugu
91–100 of 141 posts
Re: Sakana Fugu
#92Nice idea but expensive. It looks like they don’t add very low cost models like DeepSeek v4 flash into their mix.
After a few months of spending money on the best frontier models, now I am spending time using DeepSeek v4 flash as my workhorse, and flipping to more capable (but still very inexpensive) open models on an as-needed basis. We all make our own tool selection decisions, but for me, I feel happier and enjoy working more following the very fast response and ultra low cost path.
Re: Sakana Fugu
#93Earlier quoted context omitted.
Pay $0 to run a local model or even a cheap DeepSeek V4 model via their API which is close to free per million tokens. These prices are just going to get raced to $0.
Maybe. But for now it's fascinating how $200/month has kind of become a normal tier. It's similar to how AirPods normalised all of us having $300+ headphones. All of us would have scoffed at the idea a decade ago.
But, it is not all about cost: models like DeepSeek v4 flash (I use the US company Fireworks.ai and also buy tokens directly from DeepSeek) is very fast, very low latency while working.
Would you want to use a text editor that updates the screen very slowly? Kind of the same thing for using agentic systems as coding assistants: don’t want a ‘sluggish’ experience.
Re: Sakana Fugu
#94Earlier quoted context omitted.
Pay $0 to run a local model or even a cheap DeepSeek V4 model via their API which is close to free per million tokens. These prices are just going to get raced to $0.
I used to have a $20/mo ChatGPT subscription and now I spend $12 per year using Kimi models on OpenRouter, and that's with zero-data-retention-only providers (some models sometimes have free providers with scary tracking). Maybe I just don't use that many tokens, I don't fill the context with more than what's needed for a specific request, but it goes to show how these subscriptions can be an absolute ripoff. The tho…
The beauty of your approach: when people are not paying for an expensive subscription, they can decide to use models less and not feel like they are leaving money on the table.
Re: Sakana Fugu
#95Fugu, eh? So there’s a nonzero chance this thing might kill me?
Re: Sakana Fugu
#96Nice idea but expensive. It looks like they don’t add very low cost models like DeepSeek v4 flash into their mix. After a few months of spending money on the best frontier models, now I am spending time using DeepSeek v4 flash as my workhorse, and flipping to more capable (but still very inexpensive) open models on an as-needed basis. We all make our own tool selection decisions, but for me, I feel happier and enjoy…
We found that an all open source fusion was 1/3 the price and better than Fable
Re: Sakana Fugu
#97Re: Sakana Fugu
#98I tried running this for some market research for my startup and it did a pretty nice job. It didn't necessarily find any obscure data, and it seemed to rely on older data than what I could find myself. On top of this, it had the same sycophantic tendencies as most LLMs these days (explaining why your idea is great and riffing on that), which I find to be unnecessary use of resources.
All put together, paying ~$60 to get a hit-or-miss report seems a bit excessive, but obviously as the models they use under the hood get better it becomes more and more worth it, assuming they also improve their grounding/search capabilities.
I'm a big fan of Sakana though, and have followed David Ha / @hardmaru since the world models papers (with the racing car game and the Doom clone), which were incredible at the time.
Re: Sakana Fugu
#99[deleted]
Re: Sakana Fugu
#100[dead]