Earlier quoted context omitted.
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.
I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through
Anthropic’s $5B, 4-year plan to take on OpenAI
311–320 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#312Earlier quoted context omitted.
The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?
US society isn’t some anti-sex dystopia. Its average compared to the rest of the world, It’s just Europe that is super pro-nudity etc and projects. Like everything else they think they are objectively right in their beliefs and systems.
Not a dystopia, but certainly US society has, shall we say, a very strange and complicated relationship with sex and nudity.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#313If Apple would wake up to what's happening with llama.cpp etc then I don't see such a market in paying for remote access to big models via API, though it's currently the only game in town. Currently a Macbook has a Neural Engine that is sitting idle 99% of the time and only suitable for running limited models (poorly documented, opaque rules about what ops can be accelerated, a black box compiler [1] and an apparent…
1. That RAM isn't empty, it's being used by apps and the OS. Fill up 64GB of RAM with an LLM and there's nothing left for anything else.
2. 64GB probably isn't enough for competitive LLMs anyway.
3. Inferencing is extremely energy intensive, but the MacBook / Apple Silicon brand is partly about long battery life.
4. Weights are expensive to produce and valuable IP, but hard to protect on the client unless you do a lot of work with encrypted memory.
5. Even if a high end MacBook can do local inferencing, the iPhone won't and it's the iPhone that matters.
6. You might want to fine tune models based on your personal data and history, but training is different to inference and best done in the cloud overnight (probably?).
7. Apple already has all that stuff worked out for Siri, which is a cloud service, not a local service, even though it'd be easier to run locally than an LLM.
And lots more issues with doing it all locally, fun though that is to play with for developers.
I hope I'm wrong, it'd be cool to have LLMs be fully local, but it's hard to see situations where the local approach beats out the cloud approach. One possibility is simply cost: if your device does it, you pay for the hardware, if a cloud does it, you have to pay for that hardware again via subscription.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#314Earlier quoted context omitted.
> Plenty of greedy people in non-capitalist systems. Totally agreed. But I am not placing any moral value on either greed or capitalism. I would think, however, that capitalists would not ignore such an obvious profit center as the sex industry. Thus my bafflement.
> I would think, however, that capitalists would not ignore such an obvious profit center as the sex industry Because you're conflating capitalism and greed. Capitalism doesn't mean "do anything for money". It means "as much as possible, people get to decide among themselves how to allocate their money and time". Some of them will invest in anything, just as people in non-capitalist countries. Most will only invest i…
In the abstract, perhaps not. The way it exists in the US, though, it means exactly that.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#315Earlier quoted context omitted.
I would be very surprised if something based on Blockchain or similar software doesn't offer a solution here. Another route would be to establish a protocol for near instantaneous bank transfers, and try to get a lot of banks on board. The immediacy of transfers seems to be the main reason why companies use credit card services, not buyer protection or actual credit.
I have no particular love of legacy systems (whether they be banks, imperialism, or Electoral Colleges), but what about your comment is plausible given the widespread recognition that blockchain technologies have been oversold, leading to widespread fraud and failure? Maybe I’m missing something, but the above comment reminds me of the blockchain naïveté of 10 years ago. I don’t mean to be dismissive; I’m suspending…
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#316Earlier quoted context omitted.
This is not an argument for crypto, it's an argument for better regulations so that processors don't make up their own rules.
Well you can wait a lifetime or you can take control away from them with a couple clicks. The choice is obvious.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#317If Apple would wake up to what's happening with llama.cpp etc then I don't see such a market in paying for remote access to big models via API, though it's currently the only game in town. Currently a Macbook has a Neural Engine that is sitting idle 99% of the time and only suitable for running limited models (poorly documented, opaque rules about what ops can be accelerated, a black box compiler [1] and an apparent…
I wonder how good the neural engine with the unified memory is compared to say intel cpu with 32gb ram. Could anyone give some insight?
If it could use the full 'unified' memory that would be a big step towards getting these models running on it
I'm unsure how the performance compares to a beefy Intel CPU, but there's some numbers here [1] for running a variant of the small distilbert-base model on the Neural Engine... it's ~10x faster than running on the M1 CPU
[1] https://github.com/anentropic/experiments-coreml-ane-distilb...
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#318Earlier quoted context omitted.
GPT4 has built and deployed an entire SaaS for me in a week. I already have users. The edits required were minimal --- maybe one screw-up for every 100 lines of code --- and I learned a lot of better ways to do things.
Currently using GPT-4 to do a lot of heavy lifting for me for new app. Would love to see your approach!
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#319Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#320Earlier quoted context omitted.
What's with the NSFW need? I'd understand if this is some image generator, but here? Is it some sexting, "romance", or is NSFW about something else altogether?
Fanfiction. It is a huge deal to some people. Many prefer reading stories over watching porn, and we all know how big of a market pornography is.