Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

361–370 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#361

Earlier quoted context omitted.

1. You're working backwards from a desire to buy more RAM to try and find uses for it. I'm really not I had no desire at all until a couple of weeks ago. Even now not so much since it wouldn't be very useful to me But the current LLM business model where there are a small number of API providers, and anything built using this new tech is forced into a subscription model... I don't see it sustainable, and I think the…

I think llama.cpp will die soon because the only models you can run with it are derivatives of a model that Facebook never intended to be publicly released, which means all serious usage of it is in a legal limbo at best and just illegal at worst. Even if you get a model that's clean and donated to the world, the quality is still not going to be competitive with the hosted models. And yes I've played with it. It was/…

(A) is very use case depending. Even with some of the bad smaller models now, I can see devs making use of them to enhance their app (e.g. local search, summaries, sentiments, translations)

(B) llama.cpp supports gpt4all, which states that its working on fixing your concern. This is from their README:

Roadmap Short Term

- Train a GPT4All model based on GPTJ to alleviate llama distribution issues.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#362
post #83
post #3

4 years ?!? That’s like a century in AI-dog years. Who knows how the world will be by then.

AI seems to progress in bursts, and I think we're in the middle of one, but it may be naive to think the progress will continue at the same pace for another 4 years. When Big Blue beat Kasparov in Chess in 1997, I wonder if anyone would've guessed that it'd take almost 20 years for a computer to beat a master in Go. IBM Watson was launched in 2010 and had many of the same promises as GPT. It supposedly fell flat in m…

[deleted]

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#363
post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

At least for AI image generators it is a giant liability. As of two years ago AI-generated CSAM that is indistinguishable from original photographic CSAM is considered equally criminal. If users can spawn severely illegal content at will using your product you will find yourself in a boiling cauldron 30 seconds after going live. Stable diffusion no longer uses even adult NSFW material for the training dataset because…

Yep. No sane company wants to deal with the legal and PR nightmare of their product being used to generate realistic CSAM based on a child star and/or photos taken in public of some random person's kid.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#364

Earlier quoted context omitted.

It is amazing that in the year 2023, where things are possible that were science fiction until recently, we still rely on private payment processors, credit card companies, which extract fees for a service that doesn't have any technical necessity anymore. I think the reason is just inertia. They work well enough in most cases, and the fees aren't so high as to be painful, so there is little pressure to switch to som…

> I think the reason is just inertia. It is not just inertia; it is government malice. The government loves that there are effectively only two payment processors, because this lets them exercise policy pressure without the inconvenience of a democratic mandate.

Yes, financial companies mostly regulate themselves. They have lawyers telling them what regulators are likely to approve of, and make rules based on that for themselves and their customers. If they do something sufficiently bad, regulators go after them. That’s how banks get regulated, too.

That’s how most law works, actually. There’s a question of how detailed the regulations are, but mostly you don’t go to court, and if you do, whether it looks bad to the judge or jury is going to make a difference.

I’m wondering what you’re expecting from democracy? More oversight from a bitterly divided and dysfunctional Congress? People voting on financial propositions?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#365

Earlier quoted context omitted.

Almost everyone is willing to trust 3rd parties with data, including enterprise and government customers. I find it hard to believe that there are enough people willing to pay a large premium to run these locally to make it worth the R&D cost.

Having done a lot of Bank/Gov related work... I can tell you this > Almost everyone is willing to trust 3rd parties with data, including enterprise and government customers. Is absolutely not true. In it's most basic sense - sure... some data is trusted to some 3rd parties. Usually it's not the data that would be most useful for these models to work with. We're already getting tons of "don't put our code into chatGPT…

Yes, just like you might get fired for transacting sensitive company business on a personal gmail account, even if that company uses enterprise gmail.

Saying that cloud models will win over local models is not the same as saying it will be a free-for-all where workers can just use whatever cloud offering they want. It will take time to enterprisify cloud LLM offerings to satisfy business/government data security needs, but I'm sure it will happen.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#366

Earlier quoted context omitted.

People have trusted search engines with their most intimate questions for nearly 30 years and there has been what ... one? ... leak of query data during this time, and that was from AOL back when people didn't realize that you could sometimes de-anonymize anonymized datasets. It hasn't happened since. LLMs will require more than privacy to move locally. Latency, flexibility and cost seem more likely drivers.

You're still focused on trusting that my data is safe. And while I think that matters - I don't really think that's the trust I care most about. I care more about the trust I have to place in the response from the model. Hell - since you mentioned search... Just look at the backlash right now happening to google. They've sold out search (a while back, really) and people hate it. Ads used to be clearly delimited from…

You wouldn't know that even if the model ran locally.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#367

Earlier quoted context omitted.

I know you said no details, but can you at least share a little bit more about Claude LLM's code generation?

There is a language with massive usage in the enterprise but with very few (if any) high quality code examples on the public internet. When given a broad task, GPT4 doesn’t just write incorrect code, it tries to do entire categories of things the language literally cannot do because of the ecosystem it runs inside. Claude does a much better job writing usable code, but more importantly it does NOT tell you to do thin…

It's Apex I assume. Salesforce's language.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#368

Earlier quoted context omitted.

It is amazing that in the year 2023, where things are possible that were science fiction until recently, we still rely on private payment processors, credit card companies, which extract fees for a service that doesn't have any technical necessity anymore. I think the reason is just inertia. They work well enough in most cases, and the fees aren't so high as to be painful, so there is little pressure to switch to som…

I think companies accept credit card payments because that’s what their customers want and companies want to get paid.

And conversely: For online payments, credit card payments are my least preferred method. But I still use them quite often, because everyone accepts them.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#369

Earlier quoted context omitted.

> but it's hard to see situations where the local approach beats out the cloud approach. I think the most glaring situation where this is true is simply one of trust and privacy. Cloud solutions involve trusting 3rd parties with data. Sometimes that fine, sometimes it's really not. Personally - LLMs start to feel more like they're sitting in the confidant/peer space in many ways. I behave differently when I know I'm…

People have trusted search engines with their most intimate questions for nearly 30 years and there has been what ... one? ... leak of query data during this time, and that was from AOL back when people didn't realize that you could sometimes de-anonymize anonymized datasets. It hasn't happened since. LLMs will require more than privacy to move locally. Latency, flexibility and cost seem more likely drivers.

This happened with ChatGPT a few weeks ago.

https://news.ycombinator.com/item?id=35291112

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#370

Earlier quoted context omitted.

I would be very surprised if something based on Blockchain or similar software doesn't offer a solution here. Another route would be to establish a protocol for near instantaneous bank transfers, and try to get a lot of banks on board. The immediacy of transfers seems to be the main reason why companies use credit card services, not buyer protection or actual credit.

> I would be very surprised if something based on Blockchain or similar software doesn't offer a solution here. There is, it's a layer-2 on Ethereum called zkSync. It's not totally satisfactory (the company that makes it can steal your money, centralized sequencer, etc), but it's pretty mature and works quite well. To replace Visa you want high throughput and low latency and zk-rollups like zkSync can provide both. (…

[flagged]
Post reply on HN