On looking at their pricing page, I started to wonder: What's the price of tokens in and tokens out for professional human beings?
Claude 2.1
141–150 of 339 posts
Re: Claude 2.1
#142I like thinking about analogs between computers and brains. For instance, working memory as RAM, or deja vu as orphaned linked lists.
What’s the analog for LLM context windows?
Maybe consciousness is essentially a context window, and when we dream during sleep we are compressing knowledge to free up context space or something.
Re: Claude 2.1
#143Earlier quoted context omitted.
I applied a few months ago. Last week I received an email: “We’re pleased to let you know that we’re expanding access to the Claude API. As the next step in considering your application, we’ll need some further information from you. Please fill out our onboarding form.” The form seems to be the same form I filled in months before. I’ve not heard back in the 7 days since.
It is amazing to me that VCs are giving billions to these companies that have no idea how to launch or support products.
I would assume that the revenue story they are pitching to VCs is licensing the model to AWS, which has pre-existing infrastructure for distribution.
Re: Claude 2.1
#144I don’t like Anthropic. they over-RLHF their models and make them refuse most requests. A conversation with Claude has never been pleasant to me. it feels like the model has an attitude or something.
Luckily, unlike OpenAI, Anthropic lets you prefill Claude's response which means zero refusals.
OpenAI allows the same via API usage, and unlike Claude it *won't dramatically degrade performance or outright interrupt its own output if you do that.
It's impressively bad at times: using it for threat analysis I had it adhering to a JSON schema, and with OpenAI I know if the output adheres to the schema, there's no refusal.
Claude would adhere and then randomly return disclaimers inside of the JSON object then start returning half blanked strings.
Re: Claude 2.1
#145Re: Claude 2.1
#146Earlier quoted context omitted.
I don't know what you're doing with your LLM, but I've only ever had one refusal and I've been working a lot with Claude since it's in bedrock
I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing. Is it fair to assume that I won't get refusals for code generation and RAG on documentation?
since they don't have a share feature like some other open/er AI's it's difficult to compare. My favorite one to share as I recall was when Anthropic first released their chat UI. I asked it whether they had an API to which it told me know. After I shared the documentation for it's API to it it went into a forever denial of everything I asked it. I wish I still had the full dialog it was very funny.
Re: Claude 2.1
#147Earlier quoted context omitted.
Yeah but to be honest been a pain last days to get gpt 4 to write full pieces of code for more the 10-15 lines. Have to re-ask many times and at some point it forgets my initial specifications.
Earlier in the year I had ChatGPT 4 write a large, complicated C program. It did so remarkably well, and most of the code worked without further tweaking. Today I have the same experience. The thing fills in placeholder comments to skip over more difficult regions of the code, and routinely forgets what we were doing. Aside all the recent OpenAI drama, I've been displeased as a paying customer that their products rou…
Definitely degraded. I recommend being more specific in your prompting. Also if you have threads with a ton of content, they will get slow as molasses. It sucks but giving them a fresh context each day is helpful. I create text expanders for common prompts / resetting context.
eg: Write clean {your_language} code. Include {whatever_you_use} conventions to make the code readable. Do not reply until you have thought out how to implement all of this from a code-writing perspective. Do not include `/..../` or any filler commentary implying that further functionality needs to be written. Be decisive and create code that can run, instead of writing placeholders. Don't be afraid to write hundreds of lines of code. Include file names. Do not reply unless it's a full-fledged production ready code file.
Re: Claude 2.1
#148For coding it is still 10x worse than gpt4. I asked it to write a simple database sync function and it gives me tons of pseudocode like `//sync object with best practices`. When I ask it to give me real code it forgets tons of key aspects.
Am I only one that thinks that Claude 2 is not bad for programming questions? I do not think it is best one for programming questions but I do not think that it is bad too. I have received multiple times very good response from Claude 2 on Python and SQL.
Re: Claude 2.1
#149Claude 2.1 - Max context: 200k, max output: ?
$0.008 / 1000 prompt
$0.024 / 1000 completion
GPT-4 Turbo - Max context 128k, max output 4k $0.01 / 1000 prompt $0.03 / 1000 completion
Re: Claude 2.1
#1501. A 200k context is bittersweet with that 70k->195k error rate jump. Kudos on that midsection error reduction, though! 2. I wish Claude had fewer refusals (as erroneously claimed in the title). Until Anthropic stops heavily censoring Claude, the model is borderline useless. I just don't have time, energy, or inclination to fight my tools. I decide how to use my tools, not the other way 'round. Until Anthropic stops…
I've literally never had Claude refuse anything. What are you doing?