Live data from Hacker News

The Anthropic Economic Index

anthropic.com

201–210 of 238 posts

Re: The Anthropic Economic Index

#201

Words I typed into a paid service are now public on a huggingface repo. I don't care if it is anonymized. Fuck that. I am deleting my account.

Uh, this isn't true at all. Did you actually look at the repo[1]? Only the metadata (i.e., LLM-generated task names and interaction classifications) have been made available. [1] https://huggingface.co/datasets/Anthropic/EconomicIndex

People don't react to data privacy stuff with rationality, they don't care to understand anonymization. For 95% of people it's only gut instinct, and that's all it will ever be.

Re: The Anthropic Economic Index

#202

Earlier quoted context omitted.

to push this analogy too far, that's because you didn't stir it well, not because the spoon is too small.

Have to sample to see if it’s stirred well enough.

No, you can model whether stirring actions should create a representative sample

Re: The Anthropic Economic Index

#203

Earlier quoted context omitted.

> something you can almost self-teach from widely available free online content. I think you massively underestimate just how much data is online for everything , especially once you include books which are freely available on every possible subject (illegally, perhaps, but if Meta can download them for free then so can everyone else). There's less noise for many other subjects than for software engineering, there's…

Consider two fields with vast amounts of literature: medicine and law. Medicine faces two key challenges. First, while research follows the scientific method, much of what makes a good doctor—intuition, pattern recognition, and clinical judgment—is rarely documented. Second, medical data is highly sensitive, limiting access to real-world cases, images, and practice opportunities. Theory alone is not enough; hands-on…

Really fantastic comment. I would add one criteria to where self-teaching is easier: rapidly testable hypotheses.

Re: The Anthropic Economic Index

#204

This more or less confirms what I imagine most of us thought, AI is mostly used by engineers, or for engineering tasks. Makes sense, I wonder how much traffic comes from automated tasks (co-pilot, etc). Every time I read a report like this I do wonder if we'll ever see an ROI on LLMs. HUNDREDS of billions of dollars of spend, and 3 years in its still primarily the same crowd using it, and has yet to create a "killer"…

We’re trying to use it for industrial apps. Been over a year of R&D. Some good but often mixed results. Adherence to prompts is a big issue for us. It’s most useful not as a chatbot but to give explained descriptions of what the user is seeing, so they don’t need to dig down into 20 graphs and past history. That necessitates being able to refer to things with URIs which works 95% of the time but the 5% is killer sinc…

I'm curious about your approach and the nature of those industrial apps. Is it more of recommender agents accessing available sources (through URIs) - or more like explainers. Would be great to connect https://shorturl.at/xdOee

Re: The Anthropic Economic Index

#205

Earlier quoted context omitted.

This is why I cancelled my chatgpt subscription and moved to claude. Its kinda silly, but I feel like the products are about equivalent for my use case so I'd rather do business with a company that is acting in good (better?) faith.

Don't think that's silly at all.

Hope not - I haven't purchased a Nestle brand in years for this exact reason.

Re: The Anthropic Economic Index

#206

Earlier quoted context omitted.

I think the problem is the data. Software engineering is a weird niche that is both a high paying job and something you can almost self-teach from widely available free online content. If not self-teach, you can rely on free online content for troubleshooting, examples, etc. A lot of other industries/jobs are more of an apprenticeship model, with little data and even less freely available on open internet.

> something you can almost self-teach from widely available free online content. I think you massively underestimate just how much data is online for everything , especially once you include books which are freely available on every possible subject (illegally, perhaps, but if Meta can download them for free then so can everyone else). There's less noise for many other subjects than for software engineering, there's…

A significant chunk of human knowledge is not publicly accessible. You cannot self-teach how to make a modern aircraft, jet engine, nuclear reactor, radar tech, advanced metallurgy etc.

Similarly, I would wager most of the useful economics and financial theory that humans have come up with is only known to hedge or prop trading firms.

For some subjects, the entire journal-published academic body of knowledge for it is probably some useless fraction of the whole and university academia is operating nowhere close to the cutting edge. People are probably doing PhDs today on theses that some defense contractor or HFT firm already discovered 20 years ago.

Even things like specialized medical knowledge, I would wager is largely passed down through mentor-mentee tradition and/or private notes as opposed to textbooks. It's unlikely that you can teach yourself how to do surgery just from textbooks. I once had a pathologist's report use a term for a skin condition that was quite literally ungoogleable. The skin condition itself was fairly ordinary, but the term used was outright esoteric and yet probably used on a daily basis by that pathologist. Where did he learn it from?

Not everything is on the Internet.

Re: The Anthropic Economic Index

#207
post #42
post #13

Seems like Anthropic has too much money on their hands and are looking for ways to spend it. It’s surprising to see lean AI startups accumulate fat so quickly. Usually this sort of wheel spinning is reserved for large corporations. And it’s not just them. To me this trend screams “valuations are too high”, and maybe hints at “progress might start to stagnate soon”.

Anthropic is a Public Benefit Corporation whose governance is very different from a typical company in that it doesn’t put shareholder ROI above all else. A majority of its board seats are reserved for people who hold no equity whatsoever and whose explicit mandate is to look out for humanity. https://www.anthropic.com/news/the-long-term-benefit-trust https://time.com/6983420/anthropic-structure-openai-incentiv...

The attempt is commendable, but the agency problem is well understood and none of these alternative structures have really solve for it.

Re: The Anthropic Economic Index

#208

I'd love to see this analysis done for ChatGPT, which has a much bigger 'consumer' marketshare. I'm also very wary of their analysis method, given classifiers-gonna-classify. We already see it in their example of someone asking why their game is crashing and it buckets them into Computer & Mathematical occupation. I'm guessing the original question was not that of a game developer but rather a game player, so can you…

If you look at ChatGPT search volume, you can see massive dips during the summer when school is out:

https://trends.google.com/trends/explore?date=today%205-y&ge...

Which suggests that the most common use is as a tutor / cheating on homework.

Re: The Anthropic Economic Index

#209

I'd love to see this analysis done for ChatGPT, which has a much bigger 'consumer' marketshare. I'm also very wary of their analysis method, given classifiers-gonna-classify. We already see it in their example of someone asking why their game is crashing and it buckets them into Computer & Mathematical occupation. I'm guessing the original question was not that of a game developer but rather a game player, so can you…

If you look at ChatGPT search volume, you can see massive dips during the summer when school is out: https://trends.google.com/trends/explore?date=today%205-y&ge... Which suggests that the most common use is as a tutor / cheating on homework.

What I see is it going from 58 to 40 (the scale is ???), and it’s only continued to rise over time. So that maybe a common use (~30%), but it’s not the only use.

Most of those kids will continue to use it as they graduate, having embedded it in their workflow (unfortunately many will probably fully outsource all thinking to it, having learned a lot less since it did it all for them).

Re: The Anthropic Economic Index

#210
post #42

Earlier quoted context omitted.

Anthropic is a Public Benefit Corporation whose governance is very different from a typical company in that it doesn’t put shareholder ROI above all else. A majority of its board seats are reserved for people who hold no equity whatsoever and whose explicit mandate is to look out for humanity. https://www.anthropic.com/news/the-long-term-benefit-trust https://time.com/6983420/anthropic-structure-openai-incentiv...

The attempt is commendable, but the agency problem is well understood and none of these alternative structures have really solve for it.

> the agency problem is well understood

What is "the agency problem"?

Post reply on HN