Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

271–280 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#271

Earlier quoted context omitted.

> switch to something more modern such as?

I would be very surprised if something based on Blockchain or similar software doesn't offer a solution here. Another route would be to establish a protocol for near instantaneous bank transfers, and try to get a lot of banks on board. The immediacy of transfers seems to be the main reason why companies use credit card services, not buyer protection or actual credit.

[deleted]

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#272

Earlier quoted context omitted.

> switch to something more modern such as?

Crypto obviously solved this. If you remove the speculation idiocy that surrounds it, yes crypto does work as an anti-censorship currency. Someone is going to mention flashbots or something. “See this specific example proves…”

The main selling point to online shops would have to be a substantial reduction in fees compared to credit cards / PayPal. Most shops don't care about censorship since they wouldn't be affected anyway.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#273

claude-instant-v1 is one of the "best kept secrets". It is comperable in quality to gpt-3.5-turno, while being four times faster (!) and at half the price (!). We just released a minimal python library PyLLMs [1] to simplify using various LLMs (openai, anthropic, AI21..) and as a part of that we designed a LLM benchmark. All open source. [1] https://github.com/kagisearch/pyllms/tree/main#benchmarks

From my evals on nat.dev I found claude instant to give great responses and yes, avg 3-4X faster than 3.5, but one big difference atm is that anyone can sign up and get access to gpt-3.5-turbo right now, but claude is still gated behind an invite/wait list. (I'm still waiting for access for example.)

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#274

Earlier quoted context omitted.

Not necessarily more. Better in this context means clearer and enforced. PayPal is the prime example where it's operating very similar to a bank. You have an account with a balance and can send and receive money, but it doesn't see itself as a bank and in many countries doesn't have a bank license. At least in part this is done to avoid the regulatory work that comes with it. I absolutely want to force payment proces…

> it's operating very similar to a bank We might be talking at cross purposes; I'm not sure! How is it like a bank?

PayPal offers you a virtual account that you can pay money into. You can use that money to make purchases online, send and receive money from friends or other businesses. In effect, it acts like a bank account. However, it's not an actual bank account. In Europe, any money you put into that account is also not ensured by the government, like a normal account would.

If I pay with a credit card, there are processes in place to deal with fraud and charge backs. PayPal is well known to automatically close accounts with little recourse to access the money on those accounts.

They should absolutely be regulated.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#275
post #62
post #31

Earlier quoted context omitted.

Is it? I think the recent release of ChatGPT has skewed perceptions. There's no guarantee that there's going to continue to be as ground breaking shifts that have happened recently with llms and diffusion models. To continue with the popular comparison, there were a lot of apps when the iphone first launced the app store before it tapered off. If you looked at just the first year, you'd think we'd have an app for eve…

Here's the catch, people are still adapting to GPT tech, still figuring out ways to make use of it, to include it in their workflows, etc. Social impact of ChatGPT even in its current form is only getting started, it doesn't need to progress at all to be super disruptive. For example, see the frontpage story about the $80/h writer who was replaced by ChatGPT, and that just happened recently, months after ChatGPT's fi…

>We (humans) are getting boiled like the proverbial frog.

This is such a primitive way of thinking. It's more of an instinct, where you consider by default that your sole value is in your ability to generate/work. Why the hell are we working for? Isn't it to improve our lives? Or should we improve them up to the point where we still have to work? Why not use the tech itself to find better ways of organizing ourselves, without needing to work so much? UBI and things like that. Why be such limited? Why only develop tech up to the point where we would have to work less but not at all, and who decides where that point is? There's so much wrong in this framework of thinking.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#276
post #47

Earlier quoted context omitted.

True. I guess those are almost ASICs in a way just with gpu flavour interface

Way less specialized though. I think why most don't go for ASICs at this point, is because once you actually have units being produced, things have changed so much that you'd wish you had something more flexible. That's why general purpose GPUs are used today.

Didn't this happen in mining? When finally they got their machines new better tech came out already.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#277
post #253
post #225

Earlier quoted context omitted.

How is it bullshit lol. GPT4 is genuinely very expensive to train and run inference.

Could you provide a source for that claim? Other than the very long context model.

We can infer from publicly available information. BLOOM[0] was trained for four months on 384 A100 80GB GPUs, excluding architecture search. They specifically indicate (in the Huggingface page):

> Estimated cost of training: Equivalent of $2-5M in cloud computing (including preliminary experiments)

You can see from the training loss[1] that it was still learning at a good rate when it was stopped. The increased capabilities typically correlate well with the decrease in perplexity.

That makes many believe that GPT-4 was trained for vastly more GPU-hours, as also suggested by OpenAI’s CEO[2]. Especially so considering it also included training on images, unlike BLOOM.

[0]: https://arxiv.org/pdf/2211.05100.pdf

[1]: https://huggingface.co/bigscience/tr11-176B-logs/tensorboard

[2]: https://twitter.com/sama/status/1620951010318626817

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#278

claude-instant-v1 is one of the "best kept secrets". It is comperable in quality to gpt-3.5-turno, while being four times faster (!) and at half the price (!). We just released a minimal python library PyLLMs [1] to simplify using various LLMs (openai, anthropic, AI21..) and as a part of that we designed a LLM benchmark. All open source. [1] https://github.com/kagisearch/pyllms/tree/main#benchmarks

I have Claude on Slack. It is far worse than ChatGPT. I’m presuming this is not “claude-instant-v1” version, it is fast though. Any idea what version is Claude in Slack

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#279
post #40

Earlier quoted context omitted.

The main reason why companies don't allow NSFW content is because of puritan payment processors that see that stuff and then go absolute sicko mode and lock people out of the traditional finance system.

It is amazing that in the year 2023, where things are possible that were science fiction until recently, we still rely on private payment processors, credit card companies, which extract fees for a service that doesn't have any technical necessity anymore. I think the reason is just inertia. They work well enough in most cases, and the fees aren't so high as to be painful, so there is little pressure to switch to som…

I think companies accept credit card payments because that’s what their customers want and companies want to get paid.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#280
post #226

Earlier quoted context omitted.

Human brain is just an ultra large scale analog spiking neural network with some particular state realizations, not too much difference (the architecture is different, but computation seems to be universal). We even employ some internalized language models for communication purposes (together with object persistence and mental space-time models). So, while we are not yet at the level of full scale human brain emulati…

A small and probably incorrect example. You ask me a direct question - "how much is two plus two?". And I reply to you - "lemons are yellow". Can I do it? Yes I can. Can GPT-* do it? No. There is a whole lot more to human consciousness that pattern matching and synthesis. Or at least it seems so. And if human cognition is really that simple, just with more nodes, then we will soon see GPT-* programs on strike, issuin…

You likely wouldn't respond to that question with "lemons are yellow" without being in a specific context, such as being told to answer the question in an absurd way. GPT-* can definitely do the same thing in the same context, so this isn't really a gotcha.

Literal first try with GPT-4:

Me: I will ask you a question, and you will give me a completely non-sequitur response. Does that make sense?

GPT-4: Pineapples enjoy a day at the beach.

Me: How much is two plus two?

GPT-4: The moon is made of green cheese.

Post reply on HN