Earlier quoted context omitted.
I'm not sure this is entirely fair. Nobody elected the people who inspect nuclear powerplants either, but I still assume that they're doing a good job in protecting humanity. Even if they are possibly "highly priviledged".
I assume nuclear powerplants are regulated by some entity.
OpenAI’s policies hinder reproducible research on language models
391–394 of 394 posts
Re: OpenAI’s policies hinder reproducible research on language models
#392Earlier quoted context omitted.
No matter how you define it, or whether people even agree companies should be obligated to provide certain public services, we are just nowhere near that line yet in this case, net even remotely close. It’s hand-wavy to say it’s important, but this is all brand new, there are only a handful of researchers involved, the critical mass to justify what you’re suggesting does not yet exist, it won’t for some time, and the…
Agree to disagree.
What evidence is there that OpenAI’s codex has become a social utility? How many people used it to publish? Do you think the US government agrees? How likely is this case to go to court, and result in OpenAI being ordered to provide ongoing access to codex? That seems pretty far fetched to me, but I’m willing to entertain the possibility that I’m wrong.
Are you certain there aren’t problems with codex, that OpenAI isn’t working on something better, and/or shutting it down because it’s causing harm? If so, why are you certain?
Re: OpenAI’s policies hinder reproducible research on language models
#393Earlier quoted context omitted.
> Before you make policy recommendations based on ideology Ideologies are belief systems. The fact that open sourcing something is a good way to find errors in complex systems is a proven fact. AI isn't magical in that regard. It is a complex system, and experience with such systems, from economics, to climate mechanisms, to software, teaches us that predictions about them, including error detection, risk management…
> The fact that open sourcing something is a good way to find errors in complex systems is a proven fact. Is your evidence for this anything other than anecdotal? That ESR quote was given after one particular LKML interaction back in the 90's. And sure, sometimes an interaction like that happens. But just as often I've seen an email or bug report to an open-source project get completely lost. Not to mention that 1) n…
And what is the evidence for closed source being the safest option in AI?
> Namely, the fear is that we'll get an AI which is much more intelligent than us
Which is probably quite some time away, given the fact that LLMs and other generative models have neither intentionality, nor agency. So right now, and probably for a long time to come, we are not talking about existential threats in the form of Skynet.
But we ARE talking about a revolutionary technology, that will change the economic landscape for potentially hundreds of millions of people. I am pretty convinced that a majority of them will not be comfortable with decisions about these technologies being made behind closed (corporate) doors.
We are also talking about the much more immediate dangers of AI, which don't arise from super intelligent machines, but from how humans use them, how they are trained, on what, and for what purposes they are used and by whom. These as well are issues that society will want to have more eyeballs on, not less.
Other than concerns that someday an AGI might endanger humanity, both of these issues are here, right now, and we have to deal with that fact.
Re: OpenAI’s policies hinder reproducible research on language models
#394Earlier quoted context omitted.
I don't really understand this - it's like trying to explain a colleague's behaviour by saying they're doing something so they get their salary. Of course they need to have commercial gain in mind. But you need to be more specific.
From my reading of the parent's comment, they are saying the reason the models are not being made available is because of a fear they will effectively turn into SkyNet - am I being uncharitable?