Words I typed into a paid service are now public on a huggingface repo. I don't care if it is anonymized. Fuck that. I am deleting my account.
Uh, this isn't true at all. Did you actually look at the repo[1]? Only the metadata (i.e., LLM-generated task names and interaction classifications) have been made available. [1] https://huggingface.co/datasets/Anthropic/EconomicIndex
The Anthropic Economic Index
201–210 of 238 posts
Re: The Anthropic Economic Index
#202Re: The Anthropic Economic Index
#203Earlier quoted context omitted.
> something you can almost self-teach from widely available free online content. I think you massively underestimate just how much data is online for everything , especially once you include books which are freely available on every possible subject (illegally, perhaps, but if Meta can download them for free then so can everyone else). There's less noise for many other subjects than for software engineering, there's…
Consider two fields with vast amounts of literature: medicine and law. Medicine faces two key challenges. First, while research follows the scientific method, much of what makes a good doctor—intuition, pattern recognition, and clinical judgment—is rarely documented. Second, medical data is highly sensitive, limiting access to real-world cases, images, and practice opportunities. Theory alone is not enough; hands-on…
Re: The Anthropic Economic Index
#204This more or less confirms what I imagine most of us thought, AI is mostly used by engineers, or for engineering tasks. Makes sense, I wonder how much traffic comes from automated tasks (co-pilot, etc). Every time I read a report like this I do wonder if we'll ever see an ROI on LLMs. HUNDREDS of billions of dollars of spend, and 3 years in its still primarily the same crowd using it, and has yet to create a "killer"…
We’re trying to use it for industrial apps. Been over a year of R&D. Some good but often mixed results. Adherence to prompts is a big issue for us. It’s most useful not as a chatbot but to give explained descriptions of what the user is seeing, so they don’t need to dig down into 20 graphs and past history. That necessitates being able to refer to things with URIs which works 95% of the time but the 5% is killer sinc…
Re: The Anthropic Economic Index
#205Earlier quoted context omitted.
This is why I cancelled my chatgpt subscription and moved to claude. Its kinda silly, but I feel like the products are about equivalent for my use case so I'd rather do business with a company that is acting in good (better?) faith.
Don't think that's silly at all.
Re: The Anthropic Economic Index
#206Earlier quoted context omitted.
I think the problem is the data. Software engineering is a weird niche that is both a high paying job and something you can almost self-teach from widely available free online content. If not self-teach, you can rely on free online content for troubleshooting, examples, etc. A lot of other industries/jobs are more of an apprenticeship model, with little data and even less freely available on open internet.
> something you can almost self-teach from widely available free online content. I think you massively underestimate just how much data is online for everything , especially once you include books which are freely available on every possible subject (illegally, perhaps, but if Meta can download them for free then so can everyone else). There's less noise for many other subjects than for software engineering, there's…
Similarly, I would wager most of the useful economics and financial theory that humans have come up with is only known to hedge or prop trading firms.
For some subjects, the entire journal-published academic body of knowledge for it is probably some useless fraction of the whole and university academia is operating nowhere close to the cutting edge. People are probably doing PhDs today on theses that some defense contractor or HFT firm already discovered 20 years ago.
Even things like specialized medical knowledge, I would wager is largely passed down through mentor-mentee tradition and/or private notes as opposed to textbooks. It's unlikely that you can teach yourself how to do surgery just from textbooks. I once had a pathologist's report use a term for a skin condition that was quite literally ungoogleable. The skin condition itself was fairly ordinary, but the term used was outright esoteric and yet probably used on a daily basis by that pathologist. Where did he learn it from?
Not everything is on the Internet.
Re: The Anthropic Economic Index
#207Seems like Anthropic has too much money on their hands and are looking for ways to spend it. It’s surprising to see lean AI startups accumulate fat so quickly. Usually this sort of wheel spinning is reserved for large corporations. And it’s not just them. To me this trend screams “valuations are too high”, and maybe hints at “progress might start to stagnate soon”.
Anthropic is a Public Benefit Corporation whose governance is very different from a typical company in that it doesn’t put shareholder ROI above all else. A majority of its board seats are reserved for people who hold no equity whatsoever and whose explicit mandate is to look out for humanity. https://www.anthropic.com/news/the-long-term-benefit-trust https://time.com/6983420/anthropic-structure-openai-incentiv...
Re: The Anthropic Economic Index
#208I'd love to see this analysis done for ChatGPT, which has a much bigger 'consumer' marketshare. I'm also very wary of their analysis method, given classifiers-gonna-classify. We already see it in their example of someone asking why their game is crashing and it buckets them into Computer & Mathematical occupation. I'm guessing the original question was not that of a game developer but rather a game player, so can you…
https://trends.google.com/trends/explore?date=today%205-y&ge...
Which suggests that the most common use is as a tutor / cheating on homework.
Re: The Anthropic Economic Index
#209I'd love to see this analysis done for ChatGPT, which has a much bigger 'consumer' marketshare. I'm also very wary of their analysis method, given classifiers-gonna-classify. We already see it in their example of someone asking why their game is crashing and it buckets them into Computer & Mathematical occupation. I'm guessing the original question was not that of a game developer but rather a game player, so can you…
If you look at ChatGPT search volume, you can see massive dips during the summer when school is out: https://trends.google.com/trends/explore?date=today%205-y&ge... Which suggests that the most common use is as a tutor / cheating on homework.
Most of those kids will continue to use it as they graduate, having embedded it in their workflow (unfortunately many will probably fully outsource all thinking to it, having learned a lot less since it did it all for them).
Re: The Anthropic Economic Index
#210Earlier quoted context omitted.
Anthropic is a Public Benefit Corporation whose governance is very different from a typical company in that it doesn’t put shareholder ROI above all else. A majority of its board seats are reserved for people who hold no equity whatsoever and whose explicit mandate is to look out for humanity. https://www.anthropic.com/news/the-long-term-benefit-trust https://time.com/6983420/anthropic-structure-openai-incentiv...
The attempt is commendable, but the agency problem is well understood and none of these alternative structures have really solve for it.
What is "the agency problem"?