Live data from Hacker News

Claude 2.1

anthropic.com

111–120 of 339 posts

Re: Claude 2.1

#111

I would love to use their API but I can never get anyone to respond to me. It's like they have no real interest in being a developer platform. Has anyone gotten their vague application approved?

Could you use AWS Bedrock? It seems like they are going with the route of let AWS handle the developer platform aspect and they will just work on the models.

Re: Claude 2.1

#112
post #19

For coding it is still 10x worse than gpt4. I asked it to write a simple database sync function and it gives me tons of pseudocode like `//sync object with best practices`. When I ask it to give me real code it forgets tons of key aspects.

Including all of Github in your training dataset seems like a good idea

Re: Claude 2.1

#113

I don’t like Anthropic. they over-RLHF their models and make them refuse most requests. A conversation with Claude has never been pleasant to me. it feels like the model has an attitude or something.

Luckily, unlike OpenAI, Anthropic lets you prefill Claude's response which means zero refusals.

Re: Claude 2.1

#114
1. A 200k context is bittersweet with that 70k->195k error rate jump. Kudos on that midsection error reduction, though!

2. I wish Claude had fewer refusals (as erroneously claimed in the title). Until Anthropic stops heavily censoring Claude, the model is borderline useless. I just don't have time, energy, or inclination to fight my tools. I decide how to use my tools, not the other way 'round. Until Anthropic stops injecting bias into their models to create some byzantine, manic LLM omertà, I'll stick to more effective models, thanks. I'm too swamped to add "tech company decided what's best for me this time" app bugs to my backlog.

[EDIT] To avoid replies to further "the only people who want privacy must have something to hide" style arguments, my reply: https://news.ycombinator.com/item?id=38368352

Re: Claude 2.1

#115

Earlier quoted context omitted.

Makes sense as claude instant is likely better than 3.5

I dunno about that. GPT 3.5 is extremely good. I would wager that most apps that use RAG to pass context in and get JSON (or some other thing) out that you can pass to some other part of your product don't need GPT 4 or anything else equally as powerful.

> GPT 3.5 is extremely good

Maybe I just use GPT4 too much, but I disagree and most benchmarks show Clause being neck-and-neck with 3.5, especially the lmsys benchmarks which I think are the highest quality. [0] MMLU is basically broken (although even that puts Claude higher).

[0]: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...

Re: Claude 2.1

#116
post #59

And still can't be accessed from the EU. Guess Anthropic isn't too keen on complying with our data privacy regulations. Guess we'll stick to OpenAI / Microsoft (who seem to manage).

> (who seem to manage) My take on that is that MS simply accepts being sued and having to pay as part of business. At least, that is how it has been the past few years.

You could always access the vanilla OpenAI APIs from the EU as well, so unless sugar daddy also provided a legal shield, that ain't it. Also, you absolutely can operate a service that is in line with GDPR, you just need to want to.

Re: Claude 2.1

#117
Has anyone found any success with Claude or have any reason to use it?

In my tests it is nowhere near GPT 3.5 or 4 in terms of reliability or usefulness and I've even found that it is useless compared to Mistral 7b.

I don't understand what they are doing with those billions in investment when 7b open source models are surpassing them in practical day to day use cases.

Re: Claude 2.1

#119

I would love to use their API but I can never get anyone to respond to me. It's like they have no real interest in being a developer platform. Has anyone gotten their vague application approved?

Howdy, CISO of Anthropic here. I'm not sure what happened in your case but please reach out to support@ and mention my name; we'll respond ASAP.

I'm not at Anthropic but have met Jason. He's a good guy, not surprised that that he's here helping folks out

Re: Claude 2.1

#120

Earlier quoted context omitted.

That can't be, because I can ask it a simple question that an answer is maybe 1 sentence, and it repeats the question then provides a whole novel. So ton of tokens.

GPT still writes like a highschooler trying to hit a high word count :(

Like a content mill trying to keep you on the page for as long as possible! Which it was trained on.
Post reply on HN