471–480 of 1001 posts
Earlier quoted context omitted.
Would love to find out they're overfitting for pelican drawings.
Yes, Racoon on a unicycle? Magpie on a pedalo?
https://claude.ai/public/artifacts/14a23d7f-8a10-4cde-89fe-0...
Earlier quoted context omitted.
Is there a way to disable it? Sometimes I value agent not having knowledge that it needs to cut corners
90-98% of the time I want the LLM to only have the knowledge I gave it in the prompt. I'm actually kind of scared that I'll wake up one day and the web interface for ChatGPT/Opus/Gemini will pull information from my prior chats.
I've had claude reference prior conversations when I'm trying to get technical help on thing A, and it will ask me if this conversation is because of thing B that we talked about in the immediate past
Earlier quoted context omitted.
Would love to find out they're overfitting for pelican drawings.
The estimation I did 4 months ago: > there are approximately 200k common nouns in English, and then we square that, we get 40 billion combinations. At one second per, that's ~1200 years, but then if we parallelize it on a supercomputer that can do 100,000 per second that would only take 3 days. Given that ChatGPT was trained on all of the Internet and every book written, I'm not sure that still seems infeasible. http…
There are estimated to be 100 or so prepositions in English. That gets you to 4 trillion combinations.
Earlier quoted context omitted.
Paying $10 per request doesn't have me jumping at the opportunity to try it!
Makes me wonder: do employees at Anthropic get unmetered access to Claude models?
Earlier quoted context omitted.
Can you be more specific than this? does it vary in time from launch of a model to the next few months, beyond tinkering and optimization?
Yeah, happy to be more specific. No intention of making any technically true but misleading statements. The following are true: - In our API, we don't change model weights or model behavior over time (e.g., by time of day, or weeks/months after release) - Tiny caveats include: there is a bit of non-determinism in batched non-associative math that can vary by batch / hardware, bugs or API downtime can obviously change…
https://www.reddit.com/r/OpenAI/comments/1qv77lq/chatgpt_low...
Earlier quoted context omitted.
I can see a case for omitting R&D when talking about profitability, but training makes no sense. Training is what makes the model, omitting it is like omitting the cost of running the production facility of a car manufacturer. If AI companies stop training they will stop producing models, and they will run out of a products to sell.
It depends on what you're talking about If you're looking at overall profitability, you include everything If you're talking about unit economics of producing tokens, you only include the marginal cost of each token against the marginal revenue of selling that token
To me this looks likes some creative bookkeeping, or even wishful thinking. It is like if SpaceX omits the price of the satellites when calculating their profits.
I think two things are getting conflated in this discussion. First: marginal inference cost vs total business profitability. It’s very plausible (and increasingly likely) that OpenAI/Anthropic are profitable on a per-token marginal basis, especially given how cheap equivalent open-weight inference has become. Third-party providers are effectively price-discovering the floor for inference. Second: model lifecycle econ…
Dario said this in a podcast somewhere. The models themselves have so far been profitable if you look at their lifetime costs and revenue. Annual profitability just isn't a very good lens for AI companies because costs all land in one year and the revenue all comes in the next. Prolific AI haters like Ed Zitron make this mistake all the time.
Earlier quoted context omitted.
Great question, and my guess: If you build React in C++ and Rust, even if the framework is there, you'll likely need to write your components in C++/Rust. That is a difficult problem. There are actually libraries out there that allow you to build web UI with Rust, although they are for web (+ HTML/CSS) and not specifically CLI stuff. So someone needs to create such a library that is properly maintained and such. And…
Those Rust libraries have existed for some time: - https://github.com/ratatui/ratatui - https://github.com/ccbrown/iocraft - https://crates.io/crates/dioxus-tui