Earlier quoted context omitted.
I guess your data is the catch.
We don't store or train on your data. You can see more details on our privacy policy here https://docs.double.bot/legal/privacy
[dead]
Claude 3 model family
171–180 of 723 posts
Re: Claude 3 model family
#172Surpassing GPT4 is huge for any model, very impressive to pull off. But then again...GPT4 is a year old and OpenAI has not yet revealed their next-gen model.
MMLU is pretty much the only stat on there that matters, as it correlates to multitask reasoning ability. Here, they outpace GPT-4 by a smidge, but even that is impressive because I don’t think anyone else’s has to date.
MMLU is garbage. A lot of incorrect answers there.
Re: Claude 3 model family
#173What is the probability that newer models are just overfitting various benchmarks? A lot of these newer models seem to underperform GPT-4 in most of my daily queries, but I'm obviously swimming in the world of anecdata.
Re: Claude 3 model family
#174Just signed up for Claude Pro to try out the Opus model. Decided to throw a complex query at it, combining an image with an involved question about SDXL fine tuning and asking it to do some math comparing the cost of using an RTX 6000 Ada vs an H100. It made a lot of mistakes. I provided it with a screenshot of Runpod's pricing for their GPUs, and it misread the pricing on an RTX 6000 ADA as $0.114 instead of $1.14.…
Hi, CISO of Anthropic here. Thank you for the feedback! If you can share any details about the image, please share in a private message. No LLM has had an emergent calculator yet.
Hey Jason, checked your HN bio and I don't see a contact. Found you on twitter but it seems I'm unable to DM you.
Went ahead and uploaded the image here: https://imgur.com/pJlzk6z
Re: Claude 3 model family
#175Just added Claude 3 to Chat at https://double.bot if anyone wants to try it for coding. Free for now and will push Claude 3 for autocomplete later this afternoon. From my early tests this seems like the first API alternative to GPT4. Huge!
To be clear: Is this Claude 3 Opus or the Sonnet model?
Re: Claude 3 model family
#176Earlier quoted context omitted.
Hi, CISO of Anthropic here. Thank you for the feedback! If you can share any details about the image, please share in a private message. No LLM has had an emergent calculator yet.
Hey Jason, checked your HN bio and I don't see a contact. Found you on twitter but it seems I'm unable to DM you. Went ahead and uploaded the image here: https://imgur.com/pJlzk6z
Thank you!
Re: Claude 3 model family
#177Just added Claude 3 to Chat at https://double.bot if anyone wants to try it for coding. Free for now and will push Claude 3 for autocomplete later this afternoon. From my early tests this seems like the first API alternative to GPT4. Huge!
To be clear: Is this Claude 3 Opus or the Sonnet model?
opus. only the best!
Re: Claude 3 model family
#178Just signed up for Claude Pro to try out the Opus model. Decided to throw a complex query at it, combining an image with an involved question about SDXL fine tuning and asking it to do some math comparing the cost of using an RTX 6000 Ada vs an H100. It made a lot of mistakes. I provided it with a screenshot of Runpod's pricing for their GPUs, and it misread the pricing on an RTX 6000 ADA as $0.114 instead of $1.14.…
I cant wait until this is the true disruptor in the economy: "Take this $1,000 and maximise my returns and invest it where appropriate. Goal is to make this $1,000 100X"
And just let your r/wallStreetBets BOT run rampant with it...
Re: Claude 3 model family
#179Why is it unavailable in Canada?
Re: Claude 3 model family
#180has anyone tried it for coding? How does it compare to a custom GPT like grimoire?
Genuinely better from what I've tried so far.
(I tried my custom coding gpt as a system prompt.)