Earlier quoted context omitted.
> switch to something more modern such as?
I would be very surprised if something based on Blockchain or similar software doesn't offer a solution here. Another route would be to establish a protocol for near instantaneous bank transfers, and try to get a lot of banks on board. The immediacy of transfers seems to be the main reason why companies use credit card services, not buyer protection or actual credit.
Anthropic’s $5B, 4-year plan to take on OpenAI
271–280 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#272Earlier quoted context omitted.
> switch to something more modern such as?
Crypto obviously solved this. If you remove the speculation idiocy that surrounds it, yes crypto does work as an anti-censorship currency. Someone is going to mention flashbots or something. “See this specific example proves…”
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#273claude-instant-v1 is one of the "best kept secrets". It is comperable in quality to gpt-3.5-turno, while being four times faster (!) and at half the price (!). We just released a minimal python library PyLLMs [1] to simplify using various LLMs (openai, anthropic, AI21..) and as a part of that we designed a LLM benchmark. All open source. [1] https://github.com/kagisearch/pyllms/tree/main#benchmarks
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#274Earlier quoted context omitted.
Not necessarily more. Better in this context means clearer and enforced. PayPal is the prime example where it's operating very similar to a bank. You have an account with a balance and can send and receive money, but it doesn't see itself as a bank and in many countries doesn't have a bank license. At least in part this is done to avoid the regulatory work that comes with it. I absolutely want to force payment proces…
> it's operating very similar to a bank We might be talking at cross purposes; I'm not sure! How is it like a bank?
If I pay with a credit card, there are processes in place to deal with fraud and charge backs. PayPal is well known to automatically close accounts with little recourse to access the money on those accounts.
They should absolutely be regulated.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#275Earlier quoted context omitted.
Is it? I think the recent release of ChatGPT has skewed perceptions. There's no guarantee that there's going to continue to be as ground breaking shifts that have happened recently with llms and diffusion models. To continue with the popular comparison, there were a lot of apps when the iphone first launced the app store before it tapered off. If you looked at just the first year, you'd think we'd have an app for eve…
Here's the catch, people are still adapting to GPT tech, still figuring out ways to make use of it, to include it in their workflows, etc. Social impact of ChatGPT even in its current form is only getting started, it doesn't need to progress at all to be super disruptive. For example, see the frontpage story about the $80/h writer who was replaced by ChatGPT, and that just happened recently, months after ChatGPT's fi…
This is such a primitive way of thinking. It's more of an instinct, where you consider by default that your sole value is in your ability to generate/work. Why the hell are we working for? Isn't it to improve our lives? Or should we improve them up to the point where we still have to work? Why not use the tech itself to find better ways of organizing ourselves, without needing to work so much? UBI and things like that. Why be such limited? Why only develop tech up to the point where we would have to work less but not at all, and who decides where that point is? There's so much wrong in this framework of thinking.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#276Earlier quoted context omitted.
True. I guess those are almost ASICs in a way just with gpu flavour interface
Way less specialized though. I think why most don't go for ASICs at this point, is because once you actually have units being produced, things have changed so much that you'd wish you had something more flexible. That's why general purpose GPUs are used today.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#277Earlier quoted context omitted.
How is it bullshit lol. GPT4 is genuinely very expensive to train and run inference.
Could you provide a source for that claim? Other than the very long context model.
> Estimated cost of training: Equivalent of $2-5M in cloud computing (including preliminary experiments)
You can see from the training loss[1] that it was still learning at a good rate when it was stopped. The increased capabilities typically correlate well with the decrease in perplexity.
That makes many believe that GPT-4 was trained for vastly more GPU-hours, as also suggested by OpenAI’s CEO[2]. Especially so considering it also included training on images, unlike BLOOM.
[0]: https://arxiv.org/pdf/2211.05100.pdf
[1]: https://huggingface.co/bigscience/tr11-176B-logs/tensorboard
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#278claude-instant-v1 is one of the "best kept secrets". It is comperable in quality to gpt-3.5-turno, while being four times faster (!) and at half the price (!). We just released a minimal python library PyLLMs [1] to simplify using various LLMs (openai, anthropic, AI21..) and as a part of that we designed a LLM benchmark. All open source. [1] https://github.com/kagisearch/pyllms/tree/main#benchmarks
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#279Earlier quoted context omitted.
The main reason why companies don't allow NSFW content is because of puritan payment processors that see that stuff and then go absolute sicko mode and lock people out of the traditional finance system.
It is amazing that in the year 2023, where things are possible that were science fiction until recently, we still rely on private payment processors, credit card companies, which extract fees for a service that doesn't have any technical necessity anymore. I think the reason is just inertia. They work well enough in most cases, and the fees aren't so high as to be painful, so there is little pressure to switch to som…
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#280Earlier quoted context omitted.
Human brain is just an ultra large scale analog spiking neural network with some particular state realizations, not too much difference (the architecture is different, but computation seems to be universal). We even employ some internalized language models for communication purposes (together with object persistence and mental space-time models). So, while we are not yet at the level of full scale human brain emulati…
A small and probably incorrect example. You ask me a direct question - "how much is two plus two?". And I reply to you - "lemons are yellow". Can I do it? Yes I can. Can GPT-* do it? No. There is a whole lot more to human consciousness that pattern matching and synthesis. Or at least it seems so. And if human cognition is really that simple, just with more nodes, then we will soon see GPT-* programs on strike, issuin…
Literal first try with GPT-4:
Me: I will ask you a question, and you will give me a completely non-sequitur response. Does that make sense?
GPT-4: Pineapples enjoy a day at the beach.
Me: How much is two plus two?
GPT-4: The moon is made of green cheese.