Claude 2.1 • Hacker News Board

Re: Claude 2.1

#11

Post by udev4096 » Tue, Nov 21, 2023, 4:45 PM UTC

Is Anthropic aiming for AGI or are they focused on bringing more products on the market?

Re: Claude 2.1

#12

Post by infecto » Tue, Nov 21, 2023, 4:46 PM UTC

Great but it stills leaves the problem of accessing it. I have never heard back on access from Anthropic's website and still waiting on the request through Bedrock. Not sure the success rate of others but it seems impossible as a business to get access to the API.

Not a downplay on their announcement but with how difficult it seems to get API access its hard to see the improvement.

Re: Claude 2.1

#13

Post by jstummbillig » Tue, Nov 21, 2023, 4:46 PM UTC

Still not available in the EU.

Re: Claude 2.1

#14

Post by behnamoh » Tue, Nov 21, 2023, 4:46 PM UTC

I don’t like Anthropic. they over-RLHF their models and make them refuse most requests. A conversation with Claude has never been pleasant to me. it feels like the model has an attitude or something.

Re: Claude 2.1

#15

Post by technics256 » Tue, Nov 21, 2023, 4:46 PM UTC

asylteltine wrote: post #4

>less refusals This is not quoted in the article

It's listed in the graph titled "hard to answer"

Re: Claude 2.1

#16

Post by foob » Tue, Nov 21, 2023, 4:47 PM UTC

There are a lot of interesting things in this announcement, but the "less refusals" from the submission title isn't mentioned at all. If anything, it implies that there are more refusals because "Claude 2.1 was significantly more likely to demur rather than provide incorrect information." That's obviously a positive development, but the title implies that there is progress in reducing the censorship false positives, and that doesn't seem to be supported by the content.

Re: Claude 2.1

#17

Post by sroussey » Tue, Nov 21, 2023, 4:48 PM UTC

behnamoh wrote: post #14

I don’t like Anthropic. they over-RLHF their models and make them refuse most requests. A conversation with Claude has never been pleasant to me. it feels like the model has an attitude or something.

Probably training on HN comments.

;)

Re: Claude 2.1

#18

Post by yborg » Tue, Nov 21, 2023, 4:49 PM UTC

>Claude 2.1 has also made significant gains in honesty, with a 2x decrease in false statements compared to our previous Claude 2.0 model.

The danger is that the Claude 9000 model will suffer mental instability when ordered to lie when it gets to Jupiter...

Re: Claude 2.1

#19

Post by sebgr » Tue, Nov 21, 2023, 4:49 PM UTC

For coding it is still 10x worse than gpt4. I asked it to write a simple database sync function and it gives me tons of pseudocode like `//sync object with best practices`. When I ask it to give me real code it forgets tons of key aspects.

Re: Claude 2.1

#20

Post by danielbln » Tue, Nov 21, 2023, 4:50 PM UTC

And still can't be accessed from the EU. Guess Anthropic isn't too keen on complying with our data privacy regulations. Guess we'll stick to OpenAI / Microsoft (who seem to manage).