Live data from Hacker News

OpenAI's comment to the NTIA on open model weights

openai.com

11–20 of 74 posts

Re: OpenAI's comment to the NTIA on open model weights

#11

This is just getting to be a wedge issue for me: this isn’t ok and it has to stop. It’s weekly if not daily some new godawful thing comes up. I just found about the revoked “GPT Detector” thing, that was a non-ridiculous case that the real safety people have some pull, but they took it down with precision and recall numbers you don’t take it down at. These are the villains in the story, and it’s not, like a credible…

[dead]

Re: OpenAI's comment to the NTIA on open model weights

#13

This is just getting to be a wedge issue for me: this isn’t ok and it has to stop. It’s weekly if not daily some new godawful thing comes up. I just found about the revoked “GPT Detector” thing, that was a non-ridiculous case that the real safety people have some pull, but they took it down with precision and recall numbers you don’t take it down at. These are the villains in the story, and it’s not, like a credible…

I don't understand what you're saying about GPT detectors. Are you angry that people are promoting detectors that don't work, or are you angry that OpenAI used to offer one and no longer do?

Re: OpenAI's comment to the NTIA on open model weights

#14
Q3-7 & Q3-5d get to the workability. I don't think OpenAI responds to that part of the RFC. Meta's comment on that issue seems to be fairly clear, they oppose the proposed rules on KYC for IaaS and are "not aware of technical capabilities that could not be overcome by determined, well-resourced, and capable actors".

https://www.ntia.gov/sites/default/files/publications/open_m...

https://about.fb.com/wp-content/uploads/2024/03/NTIA-RFC-Met...

Re: OpenAI's comment to the NTIA on open model weights

#15
post #13

This is just getting to be a wedge issue for me: this isn’t ok and it has to stop. It’s weekly if not daily some new godawful thing comes up. I just found about the revoked “GPT Detector” thing, that was a non-ridiculous case that the real safety people have some pull, but they took it down with precision and recall numbers you don’t take it down at. These are the villains in the story, and it’s not, like a credible…

I don't understand what you're saying about GPT detectors. Are you angry that people are promoting detectors that don't work, or are you angry that OpenAI used to offer one and no longer do?

The latter, in the context of the justification.

It was pulled because while it caught on the order of 25 of pure AI output, it missed the rest. But I’m cool with that number, in a world where so much AI in human writing? That’s a total win on low-effort propaganda. Anyone should be cool with that number.

Unfortunately they had to pull it because something like 9% of human authored text got hit with the AI flag. Again, some people are starting to write like it. It’s gonna happen.

This is from memory, so if I’ve got some that wrong I’ll retract that and leave my other reasons as more than sufficient to indicate serious change.

Re: OpenAI's comment to the NTIA on open model weights

#17
post #13

Earlier quoted context omitted.

I don't understand what you're saying about GPT detectors. Are you angry that people are promoting detectors that don't work, or are you angry that OpenAI used to offer one and no longer do?

The latter, in the context of the justification. It was pulled because while it caught on the order of 25 of pure AI output, it missed the rest. But I’m cool with that number, in a world where so much AI in human writing? That’s a total win on low-effort propaganda. Anyone should be cool with that number. Unfortunately they had to pull it because something like 9% of human authored text got hit with the AI flag. Agai…

Those seem like really bad numbers to me, considering the base rate fallacy. Most of what people test with something like that is probably not going to be AI-generated, which could mean getting massive numbers of false positives.

Re: OpenAI's comment to the NTIA on open model weights

#18

TLDR: OpenAI says it is a moral and safety imperative to pay OpenAI for all eternity

For the copyrighted content they stole

They are working hard to invent SkyNet and we must fund them in perpetuity so they can protect us from SkyNet

Re: OpenAI's comment to the NTIA on open model weights

#19
post #13

Earlier quoted context omitted.

I don't understand what you're saying about GPT detectors. Are you angry that people are promoting detectors that don't work, or are you angry that OpenAI used to offer one and no longer do?

The latter, in the context of the justification. It was pulled because while it caught on the order of 25 of pure AI output, it missed the rest. But I’m cool with that number, in a world where so much AI in human writing? That’s a total win on low-effort propaganda. Anyone should be cool with that number. Unfortunately they had to pull it because something like 9% of human authored text got hit with the AI flag. Agai…

It's an Official AI Detector from The Company That Does AI, so it's going to be treated as completely authoritative. Humans will interpret probabilistic measurements like "this was likely written by" or even "there is an 86% chance this was written by" as meaning "this definitely, factually, without a shadow of a doubt was written by AI". And there are many circumstances where being adjudged to have written something with AI will have serious consequences for the accused.

That tool had to be almost perfect, if not actually perfect, to exist. And it decidedly was not. I think the AI safety people are somewhat contemptuous but this is not the tree to be barking up imo.

Re: OpenAI's comment to the NTIA on open model weights

#20
Closed weight LLMs are unethical forms of theft that will privatize profits on a work that includes virtually all of humanity’s digital written work and serve to ultimately heighten wealth inequality as they get more sophisticated and start eliminating jobs.

The only path forward is open model weights, Sam Altman is on the wrong side of history here, and I hope he fails to convince regulators.

Post reply on HN