191–200 of 723 posts
No update on availability in European Union (still unavailable) :/
Crazy to be so ahead of the curve but sacrifice all first mover advantage in an entire continent like this.
Also, Mistral is in Europe. By the time they enter the EU there will only be breadcrumbs left.
Trying to subscribe to pro but website keeps loading (404 to stripe's /invoices is the only non 2xx I see)
Just added Claude 3 to Chat at https://double.bot if anyone wants to try it for coding. Free for now and will push Claude 3 for autocomplete later this afternoon. From my early tests this seems like the first API alternative to GPT4. Huge!
Emacs implementation when? ;)
Earlier quoted context omitted.
>>So far gpt is the only one able to answer to variations of these prompts You're saying that when Mistral Large launched last week you tested it on (among other things) explaining jokes?
Sorry I did what? When?
Just signed up for Claude Pro to try out the Opus model. Decided to throw a complex query at it, combining an image with an involved question about SDXL fine tuning and asking it to do some math comparing the cost of using an RTX 6000 Ada vs an H100. It made a lot of mistakes. I provided it with a screenshot of Runpod's pricing for their GPUs, and it misread the pricing on an RTX 6000 ADA as $0.114 instead of $1.14.…
I'm convinced GPT is running separate helper functions on input and output tokens to fix the 'tokenization' issues. As in, find items of math, send it to this hand made parser and function, then insert result into output tokens. There's no other way to fix the token issue. For reference, Let's build the GPT Tokenizer https://www.youtube.com/watch?v=zduSFxRajkE
Earlier quoted context omitted.
Anthropic is also not really a traditional startup. It’s just some large companies in a trench coat.
How so? Because they have taken large investments from Amazon and Google? Or would you also characterize OpenAI as "Microsoft in a trench coat"?
The Opus model that seems to perform better than GPT4 is unfortunately much more expensive than the OpenAI model. Pricing (input/output per million tokens): GPT4-turbo: $10/$30 Claude 3 Opus: $15/$75
Yeah the output pricing I think is really interesting, 150% more expensive input tokens 250% more expensive output tokens, I wonder what's behind that? That suggests the inference time is more expensive then the memory needed to load it in the first place I guess?
Nitpick: It's 50% and 150% more respectively.
Earlier quoted context omitted.
Why is that ? Thanks for the tip that will help 700 million people.
They don't want to comply with the GDPR or other EU laws.
GDPR is easy to comply with unless you don't offer basic privacy to your users/customers.
Earlier quoted context omitted.
Crazy to be so ahead of the curve but sacrifice all first mover advantage in an entire continent like this.
That continent wants their citizens to be safe. So, their citizens are going to pay the price of not having access to these developments as they are happening. I really doubt any of these big players will willingly launch in EU given how big the fines are from EU.
Earlier quoted context omitted.
How would that work technically, from a cost of goods sold perspective? (honestly asking, curious)
The "cost" is storing the state of the LLM after processing the input. My back-of-the-envelop guesstimate gives me 1GB to capture the 8bit state of 70B parameters model (I might be wrong though, insights are welcome), which is quite manageable with NVMe storage for fast reload. The operator would charge per pay per "saved" prompt, plus maybe a fix per call fee to re-load the state.