Earlier quoted context omitted.
Interesting. I use Flash for making the plans and GPT for execution.
flash for plans?! i don't understand why you wouldnt use something far stronger for the most load bearing point of the project
DeepSeek V4 Pro 0813
411–420 of 493 posts
Re: DeepSeek V4 Pro 0813
#412Earlier quoted context omitted.
This is true and is only becoming more important the more they improve. I am already moving to checking so they're at least somewhat following the status quo and otherwise prioritizing price and platform. I think this will be an emerging way of viewing AI in 2027 and the winner will probably be open models and China.
I think this likely plateaus and we all just get the smartest intelligence humans need running locally…
Re: DeepSeek V4 Pro 0813
#413Based on my experience so far, compared to previous models, DeepSeek V4 Pro achieves results equal to or even better than before, but at a lower cost.
Re: DeepSeek V4 Pro 0813
#414Earlier quoted context omitted.
It's interesting that all three of those used roughly the same amount of tokens, and almost entirely output. Feels like the thinking level lever didn't alter cost at all for this specific task, even though it did change the output.
I never trust OpenRouter to forward parameters correctly and would only ever conduct benchmarks with the official api, personally.
Re: DeepSeek V4 Pro 0813
#415Re: DeepSeek V4 Pro 0813
#416Earlier quoted context omitted.
it's confidential compute, it's open source and you can verify yourself that it's not reading the prompts
Open source doesn't matter if someone else is running it, right? They can change it? As long as the prompt is not encrypted at some point, and I don't think LLMs can run on encrypted prompts, then it can be read.
Re: DeepSeek V4 Pro 0813
#417Earlier quoted context omitted.
it's not open, I know people rejected by them (then they went to my site to be listed Trustedrouter.com)
You accept any and every registration? I think that goes a bit beyond an open market and into a completely unregulated one I'd never want to route my sessions through. Thanks for providing the conflicting interest disclosure though, too often people don't bother.
Re: DeepSeek V4 Pro 0813
#418Earlier quoted context omitted.
How do you define intelligence? I encounter that kind of sentiment all too often, and I have to assume we go by wildly different understanding of what that might entail.
My definition is that I can be much less precise with AI the more intelligent it is. It can extract the intent from my fuzzy description of the problem. Which means I can offload some of the thinking effort. It wasn't possible a couple years ago. I used to make fun of people who were trying to get ChatGPT to think about the problem when all it could do was write code from the pseudocode you provide. But now I can say…
These systems are not "intelligent" if you follow the dictionary definition. Hence the question posed to get a better understanding of how it is being used in this context.
They also do not "extract intent". There is for sure some intent behind your input to the service. What follows is a predictive text that uses your input, together with a LLM trained on a corpus with similar relations, that ultimately gives you a series of words.
That isn't to say a service like this cannot be useful. But I'm often wondering if the people who rely on these, and are particularly enthused by them, are actually aware that the terms they used are in fact anthropomorphized. I start by giving the benefit of the doubt, but it rarely lasts. 'Reasoning', 'agent', 'skill' 'hallucinate', 'know', 'think', 'train', 'learn', 'understand', 'harness', 'attention', 'context', 'prompt'.
Re: DeepSeek V4 Pro 0813
#419Earlier quoted context omitted.
Open source doesn't matter if someone else is running it, right? They can change it? As long as the prompt is not encrypted at some point, and I don't think LLMs can run on encrypted prompts, then it can be read.
With confidential compute / TEEs you can guarantee that the code is running, it's verifiable with remote attestation
What if the GPU has a custom bios flash that somehow logs the unencrypted prompts?
Re: DeepSeek V4 Pro 0813
#420Earlier quoted context omitted.
Open source doesn't matter if someone else is running it, right? They can change it? As long as the prompt is not encrypted at some point, and I don't think LLMs can run on encrypted prompts, then it can be read.
With confidential compute / TEEs you can guarantee that the code is running, it's verifiable with remote attestation