Live data from Hacker News

Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

anthropic.com

111–120 of 758 posts

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#111
post #87

Of course there's great inefficiency in having the Claude software control a computer with a human GUI mediating everything, but it's necessary for many uses right now given how much we do where only human interfaces are easily accessible. If something like it takes off, I expect interfaces for AI software would be published, standardized, etc. Your customers may not buy software that lacks it. But what I really want…

I hope specialized interfaces for AI never happen. I want AI to use human interfaces, because I want to be empowered to use the same interfaces as AI in the future. A future where only AI can do things because it uses an incomprehensible special interface and the human interface is broken or non-existent is a dystopia.

I also want humanoid robots instead of specialized non-humanoid robots for the same reason.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#112
post #73

Earlier quoted context omitted.

I don't think that's correct. This looks like a new model. Significant jump in math and gpqa scores.

If the architecture is the same, and the training scripts/data is the same, but the training yielded slightly different weights (but still same model architecture), is it a new model or just a iteration on the same model? What if it isn't even a re-training from scratch but a fine-tune of an existing model/weights release, is it a new version then? Would be more like a iteration, or even a fork I suppose.

Yes, it's a new model, but not a Claude 4.

It's the same, but a bit different; Claude 3.6 makes sense to me.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#113

Fascinating. Though I expect people to be concerned about privacy implications of sending screenshots of the desktop, similar to the backlash Microsoft has received about their AI products. Giving the remote service actual control of the mouse and keyboard is a whole another level! But I am very excited about this in the context of accessibility. Screen readers and screen control software is hard to develop and hard…

I suspect businesses will create VDI's or VM's for this express purpose. One because it scales better, and 2 because you can control what it has access to easier and isolate those functions.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#115
post #15

Earlier quoted context omitted.

For a company selling intelligence, that's a pretty stupid way of labelling a new product.

"computer use" is also as bad a marketing choice as possible for something that actually seems pretty cool.

It’s simple and easy to understand what it is, that’s good marketing to my ears.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#116
post #67

Earlier quoted context omitted.

You can use it in Cursor - called "Cursor Tab" IMO Cursor Tab performs much better than Co-Pilot, easily works through things that would cause Co-Pilot to get stuck, you should give it a try

As I understand Cursor tab autocomplete uses their own model. Only chat has Sonnet and co.

Ah, i thought it used the model selected for your prompts, either way, it seems to work very well

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#117
post #41

Great progress from Anthropic! They really shouldn't change models from under the hood, however. A name should refer to a specific set of model weights, more or less. On the other hand, as long as its actually advancing the Pareto frontier of capability, re-using the same name means everyone gets an upgrade with no switching costs. Though, all said, Claude still seems to be somewhat of an insider secret. "ChatGPT" ha…

There was a recent article[0] trending on HN a about their revenue numbers, split by B2C vs B2B. Based on it, it seems like Anthropic is 60% of OpenAI API-revenue wise, but just 4% B2C-revenue wise. Though I expect this is partly because the Claude web UI makes 3.5 available for free, and there's not that much reason to upgrade if you're not using it frequently. [0]: https://www.tanayj.com/p/openai-and-anthropic-reve…

3.5 is rate limited free, same as 4o (4o's limits are actually more generous). I think the real reason is much simpler - Claude/Anthropic has basically no awareness in the general public compared to Open AI.

The chatGPT site had over 3B visits last month (#11 in Worldwide Traffic). Gemini and Character AI get a few hundred million but Claude doesn't even register in comparison. [0]

Last they reported, OpenAI said they had 200M weekly active users.[1] Anthropic doesn't have anything approaching that.

[0] https://www.similarweb.com/blog/insights/ai-news/chatgpt-top...

[1] https://www.reuters.com/technology/artificial-intelligence/o...

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#118
post #102
post #85

Earlier quoted context omitted.

> I don't understand why this seems purposefully ambiguous? I wouldn't attribute this to malice when it can also be explained by incompetence. Sonnet 3.5 New > Opus 3 > Sonnet 3.5 is generally how they stack up against each other when looking at the total benchmarks. "Sonnet 3.5 New" has just been announced, and they likely just haven't updated the marketing copy across the whole page yet, and maybe also haven't figu…

> I wouldn't attribute this to malice when it can also be explained by incompetence. I don't think it's malice either, but if Opus costs more to them to run, and they've already set a price they cannot raise, it makes sense they want people to use models they have a higher net return on, that's just "business sense" and not really malice. > and they likely just haven't updated the marketing copy across the whole page…

> Which ones are you looking at? Since the benchmark comparison in the blogpost itself doesn't include Opus at all.

I manually compared it with the values from the benchmarks they published when they originally announced the Claude 3 model family[0].

Not all rows have a 1:1 row in the current benchmarks, but I think it paints a good enough picture.

[0]: https://www.anthropic.com/news/claude-3-family

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#119
post #93

Offtopic but youtube doesn't allow me to view the embedded video, with a "Sign in to confirm you’re not a bot" message. I need to open a dedicated youtube tab to watch it The barrier to scraping youtube has increased a lot recently, I can barely use yt-dlp anymore

That's funny. I was recently scraping tens of thousands of YouTube videos with yt-dlp. I would encounter throttling of some kind where yt-dlp stopped working, but I'd just spin a new VPS up and the throttled VPS down when that happened. The throttling effort cost me ~1 hour of writing the logic to handle it.

I say that's funny because my guess would be they want to block larger scale scraping efforts like mine, but completely failed, while they attempt at throttling puts captchas in front of legitimate users.

Re: Computer use, a new Claude 3.5 Sonnet, and Claude 3.5 Haiku

#120
Claude is absurdly better at coding tasks than OpenAI. Like it's not even close. Particularly when it comes to hallucinations. Prompt for prompt, I see Claude being rock solid and returning fully executable code, with all the correct imports, while OpenAI struggles to even complete the task and will make up nonexistent libraries/APIs out of whole cloth.
Post reply on HN