Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

281–290 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#281
post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

At least for AI image generators it is a giant liability. As of two years ago AI-generated CSAM that is indistinguishable from original photographic CSAM is considered equally criminal. If users can spawn severely illegal content at will using your product you will find yourself in a boiling cauldron 30 seconds after going live.

Stable diffusion no longer uses even adult NSFW material for the training dataset because the model is too good at extrapolating. There are very few pictures of iguanas wearing army uniforms, but it has seen lots of iguanas and lots of uniforms and is able to skillfully combine them. Unfortunately the same is true for NSFW pictures of adults and SFW pictures of children.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#282
post #100

Earlier quoted context omitted.

I can confirm, you can see the LLM generated cracked news that someone shared a couple days back. LLM generated articles, comments, and the full suite. It sounded very real even with funny sounding topics lol https://crackernews.github.io/

This is so brilliant! But wow. Look at one of the generated comments, self-awareness incoming soon. > What if we're all just GPT-generated comments in a GPT-generated world, and this is our existence now? https://crackernews.github.io/comments/startuptechnews.com-g...

Hahaha I hadn't read that one.

This made my day too

codeWrangler42 32 minutes ago | parent | next [–]

This is getting out of hand. GPT-10 generating entire startups now? What's next? GPT-20 generating entire planets? reply

devRambler 12 minutes ago | parent | next [–]

I can't wait for GPT-30, it'll solve world hunger by generating perfectly optimized food distribution systems. reply

quantumLeap2023 4 minutes ago | parent | next [–]

GPT-40 will probably just generate an entirely new universe for us to live in. reply

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#283

Earlier quoted context omitted.

There is a language with massive usage in the enterprise but with very few (if any) high quality code examples on the public internet. When given a broad task, GPT4 doesn’t just write incorrect code, it tries to do entire categories of things the language literally cannot do because of the ecosystem it runs inside. Claude does a much better job writing usable code, but more importantly it does NOT tell you to do thin…

GPT4 has built and deployed an entire SaaS for me in a week. I already have users. The edits required were minimal --- maybe one screw-up for every 100 lines of code --- and I learned a lot of better ways to do things.

Currently using GPT-4 to do a lot of heavy lifting for me for new app. Would love to see your approach!

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#284
post #168

Earlier quoted context omitted.

It is not clear if (i) a lot of the surplus will be captured by the AI providers and (ii) that the impact will be anywhere as big as people now guess/want it to be. Making a bet on the future is fine, of course.

My question would also be what kind of insight McKinsey can provide here. What, if anything, do they know about AI that we don't know?

You don't need to just take one source. OpenAI authored their own paper [1] on the economic impacts of just LLMs: "Our findings reveal that around 80% of the U.S. workforce could have at least 10% of their work tasks affected by the introduction of LLMs, while approximately 19% of workers may see at least 50% of their tasks impacted."

Goldman Sachs Research just pushlished their own analysis as well. [2] Their conclusions are "As tools using advances in natural language processing work their way into businesses and society, they could drive a 7% (or almost $7 trillion) increase in global GDP and lift productivity growth by 1.5 percentage points over a 10-year period." and "Analyzing databases detailing the task content of over 900 occupations, our economists estimate that roughly two-thirds of U.S. occupations are exposed to some degree of automation by AI. They further estimate that, of those occupations that are exposed, roughly a quarter to as much as half of their workload could be replaced."

[1] https://arxiv.org/pdf/2303.10130.pdf

[2] https://www.goldmansachs.com/insights/pages/generative-ai-co...

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#285
post #125
post #42

Earlier quoted context omitted.

Also quality of google search after the first few years didn't meaningfully improve as a user. I'd expect the big ramp up we're in to taper off as well. Once you reach the point where you train a model on the corpus of "the whole internet", that's it, all you can do is incrementally train it. Of course there can be whole new architectures but that's harder to put your eggs in for investing.

You're forgetting that AI has not been trained on YouTube yet and that's the next big thing. Multi-modality still has a lot of gas left in it.

I don't think there's enough third world countries to categorize and sanitize a dataset from YouTube. Meta would have to "give internet" to a few more before we can start dreaming that big.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#287
post #49

Imagine calling your machine learning startup names like "Anthropic" or "Humane". The lack of self-awareness in some executives is mind boggling.

Why not? If we want to build AGI, that’s a good name to choose.

For precisely the reason you state.

They're in the business of making money, not agi, yet all it takes is a carefully-crafted name and people forget about their legal motives and can't stop thinking about Skynet.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#288
If Apple would wake up to what's happening with llama.cpp etc then I don't see such a market in paying for remote access to big models via API, though it's currently the only game in town.

Currently a Macbook has a Neural Engine that is sitting idle 99% of the time and only suitable for running limited models (poorly documented, opaque rules about what ops can be accelerated, a black box compiler [1] and an apparent 3GB model size limit [2])

OTOH you can buy a Macbook with 64GB 'unified' memory and a Neural Engine today

If you squint a bit and look into the near future it's not so hard to imagine a future Mx chip with a more capable Neural Engine and yet more RAM, and able to run the largest GPT3 class models locally. (Ideally with better developer tools so other compilers can target the NE)

And then imagine it does that while leaving the CPU+GPU mostly free to run apps/games ... the whole experience of using a computer could change radically in that case.

I find it hard not to think this is coming within 5 years (although equally, I can imagine this is not on Apple's roadmap at all currently)

[1] https://github.com/hollance/neural-engine

[2] https://github.com/smpanaro/more-ane-transformers/blob/main/...

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#289
post #106

Earlier quoted context omitted.

The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?

You're conflating capitalism and greed. Plenty of greedy people in non-capitalist systems.

[deleted]

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#290

Lol, "Therapy and coaching". None of you ever had undergone one therapy session. Otherwise you'd know that 90% is the human connection to the therapist, not the talking or the type of therapy.

That’s not true. Correspondence therapy is a thing. Plenty of research exists in the area of delivering therapy and the effectiveness of different kinds.
Post reply on HN