Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

441–450 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#442

Earlier quoted context omitted.

> we still rely on private payment processors, credit card companies, which extract fees for a service that doesn't have any technical necessity anymore The technical necessity is there; for your chase-backed visa card to pull money from chase and deposit it into your shop's citibank, there needs to be some infrastructure. Whether a private company or the government provides this infrastructure is another story. (Alt…

Do you have an estimate of the cost of the infrastructure required vs. how much credit card companies charge today?

In Q4 2022, Visa had a revenue of 7.94B, net income of 4.18B, and net profit margin of 52.66%.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#443
post #435
post #433

Earlier quoted context omitted.

But they haven't exposed them to use. They are missing a tremendous opportunity. They have that unique unified memory model on the m1/m2 arms so they have something no other consumer devices have. If they exposed their neural chips they'd solidify their lead. They could sell a lot more hardware.

They are though. Apple released a library to use Apple Silicon for training via PyTorch recently, and has libraries to leverage the NE in CoreML.

Thank you! I wasn't aware of that. Let me research that. May 2022 announcement. Is this suitable for the the apps like llama.cpp since it's a Python library? It appears to be a library but they didn't document how to use the underlying hardware - but I welcome more info.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#444

Earlier quoted context omitted.

Crypto obviously solved this. If you remove the speculation idiocy that surrounds it, yes crypto does work as an anti-censorship currency. Someone is going to mention flashbots or something. “See this specific example proves…”

The main selling point to online shops would have to be a substantial reduction in fees compared to credit cards / PayPal. Most shops don't care about censorship since they wouldn't be affected anyway.

Yeah I don’t see that happening anymore. Crypto is always going to have fees and off-ramps, although I do think it’s helped create competition in the transfer space.

The real way crypto will work or not work is programmable money. If that works that will be huge, if it doesn’t then maybe someone will pick it back up 50 years from now.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#445
post #80
post #52

Earlier quoted context omitted.

It's trivial to fine tune llamma to be NSFW if that's what you want. But there's an entire universe of much more interesting apps that people don't want NSFW stuff in. That's why most foundation models filter it out.

Anything involving llamma is not trivial - if I can't do it on my phone through a website, then you shouldn't expect anyone else to be able to do it. If your instructions involve downloading something, or even so much as touching the command line, it makes it a non-starter for 95% of users. Get something on the level of character.ai and then you can tell me it's "trivial".

The context of this thread is a company spending $4B with a 4 year plan to build foundation models. One could do what I suggested in between days and months of work for a single person, including building a user-friendly front end.

In the context of this thread it is trivial.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#446

Earlier quoted context omitted.

1. You're working backwards from a desire to buy more RAM to try and find uses for it. You don't actually need more RAM to use LLMs, ChatGPT requires no local memory, is instant and is available for free today. 2. Why would anybody be satisfied with a 64GB model when GPT-4 or 5 or 6 might even be using 1TB of RAM? 3. That may not be the case. With every day that passes, it becomes more and more clear that large LLMs…

1. You're working backwards from a desire to buy more RAM to try and find uses for it. I'm really not I had no desire at all until a couple of weeks ago. Even now not so much since it wouldn't be very useful to me But the current LLM business model where there are a small number of API providers, and anything built using this new tech is forced into a subscription model... I don't see it sustainable, and I think the…

It sounds like we are in a similar position. I had no desire to get a 64gb laptop from apple until all the interesting things from running llama locally came out. I wasn't even aware of the specific benefit of that uniform memory model on the mac. Now I'm looking at do I want to do 64, 96 or 128gb. For an insane amount of money, 5k for that top end one.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#447

Earlier quoted context omitted.

Maybe they bought the domain name for a mutually agreeable price?

It's the trademark that matters i thought (possibly naively), since anthropic.ai was registered in 2020 for a product built in 2019, it seems, and the Anthropic spin off from OpenAI was formed in 2021, seems to have purchased a squatted domain name of anthropic.com then. Kind of unsure how it all works.

Well you can also buy a trademark, right? Though I think different companies are allowed the same trademarks if the things being trademarked aren’t confusable

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#448

Earlier quoted context omitted.

How much does 64GB of RAM cost, anyway? Retail it's like $200, and I'm sure it's cheaper in terms of Apple cost. Yet we treat it as an absurd luxury because Apple makes you buy the top-end 16" Macbook and pay an extra $800 beyond that. Maybe in the future they'll treat RAM as a requirement and not a luxury good.

and we know that more will be cheaper in future

With the integrated ram and cpu and gpu on apple silicon, however it's done it yields perf results. I do think that probably has higher cost than separately produced ram. And even separate from that, because they have that unified memory model unlike every other consumer device they can charge for it. So 64, 96 or 128 gb?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#449
post #438

Earlier quoted context omitted.

If I were Apple I'd be thinking about the following issues with that strategy: 1. That RAM isn't empty, it's being used by apps and the OS. Fill up 64GB of RAM with an LLM and there's nothing left for anything else. 2. 64GB probably isn't enough for competitive LLMs anyway. 3. Inferencing is extremely energy intensive, but the MacBook / Apple Silicon brand is partly about long battery life. 4. Weights are expensive t…

I've been looking into buy a mac for llm experimentation - 64, 96 or 128gb of ram? I'm trying to decide if 64gb is enough, or should I go to 96gb or even 128gb. But it's really expensive - even for an overpaid software engineer. Then there's the 1 or 2 tb storage question. Apple list price is another $400 for that second tb of storage. For 64gb of ram, you can get an m2 pro, or get 96gb which requires the upgraded cp…

I’m pretty sure you can get a purpose-built pc tower in that range. Why would you favor a Mac over that? A lot of this stuff only has limited support for MacOS.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#450
post #44

"Dario Amodei, the former VP of research at OpenAI, launched Anthropic in 2021 as a public benefit corporation, taking with him a number of OpenAI employees, including OpenAI’s former policy lead Jack Clark. Amodei split from OpenAI after a disagreement over the company’s direction, namely the startup’s increasingly commercial focus." So Anthropic is the Google-supported equivalent of OpenAI? Isn't the founder going…

[deleted]
Post reply on HN