Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OPT: Open Pre-trained Transformer Language Models

arxiv.org

Post reply on HN
Print view View original

121–130 of 242 posts

Re: OPT: Open Pre-trained Transformer Language Models

#121

Post by ALittleLight »

alar44 wrote: post #100
ALittleLight wrote: post #5

Earlier quoted context omitted.

I don't like "available on request". I just want to download it and see if I can get it to run and mess around with it a bit. Why do I have to request anything? And I'm not an academic or researcher, so will they accept my random request? I'm also curious to know what the minimum requirements are to get this to run in inference mode.

Gimme gimme. I want all your research and man hours for free. Gimme gimme. They are a for profit company and don't need to release anything. It's not that hard to understand.

Sure, but I'm an individual and free to say what I do and don't like. Why is that hard to understand?

Re: OPT: Open Pre-trained Transformer Language Models

#122

Post by onethought »

daenz wrote: post #45
p1esk wrote: post #43

Earlier quoted context omitted.

How can you identify content generated with them?

By training a GAN. A trained GAN will be able to accurately guess whether a block of text was produced by this GPT model, some other GPT model, or is authentic.

Just so I understand you properly:

Original Inputs (A) -> NN (Q) -> Output (X)

You are saying you could train something that would take X and identify that it is the product of NN (Q). Even though you don't know A?

So, to simplify and highlight the absurdity: If I made a NN that would complete sentences by putting a full stop on the end of open sentences. You could train something that could detect that separately to a human placed full stop?

(This seems actually impossible, there is an information loss that occurs that can't be recovered)

Re: OPT: Open Pre-trained Transformer Language Models

#123

Post by throwawayohio »

ad_hominem wrote: post #96
VectorLock wrote: post #69

Earlier quoted context omitted.

Thats interesting, any good sources for this accusation?

Not handy, and I'm not going to spend my evening digging. It may've also been one of the NGOs ideologically aligned with him that credited him for the data + assistance

If it's so egregious is it really that hard to find an example of the bias?

Calling the integrity of a single person operation into question, but then backing out with no evidence and even saying it might not have even been them seems a bit irresponsible.

Re: OPT: Open Pre-trained Transformer Language Models

#124

Post by [deleted] »

ad_hominem wrote: post #56
thorum wrote: post #31

A quick summary of the Limitations section: - "OPT-175B does not work well with declarative instructions or point-blank interrogatives." - "OPT-175B also tends to be repetitive and can easily get stuck in a loop. While sampling can reduce the incidence rate of repetitive behavior (Holtzman et al., 2020), we anecdotally found it did not eliminate it entirely when only one generation is sampled." - "We also find OPT-17…

> Pushshift.io Reddit corpus Pushshift is a single person with some very strong political opinions who has specifically used his datasets to attack political opponents. Frankly I wouldn't trust his data to be untainted. These models really need to be trained on more official data sources, or at least something with some type of multi-party oversight rather than data that effectively fell off the back of a truck. edit…

[deleted]

Re: OPT: Open Pre-trained Transformer Language Models

#126

Post by daenz »

onethought wrote: post #122
daenz wrote: post #45

Earlier quoted context omitted.

By training a GAN. A trained GAN will be able to accurately guess whether a block of text was produced by this GPT model, some other GPT model, or is authentic.

Just so I understand you properly: Original Inputs (A) -> NN (Q) -> Output (X) You are saying you could train something that would take X and identify that it is the product of NN (Q). Even though you don't know A? So, to simplify and highlight the absurdity: If I made a NN that would complete sentences by putting a full stop on the end of open sentences. You could train something that could detect that separately to…

Can you identify GPT text versus authentic text? If so, then there are features in that text that give it away. It stands to reason that there exist other features in the text, based on the training data the model was fed, and other characteristics of the model, that a discriminator model could use to detect, with some confidence, which model produced the text. A discriminator model which can detect a specific generative model essentially captures its "fingerprint".

An example of some of these features might be the use of specific word pairs around other word pairs. Or a peculiar verb conjugation in the presence of a specific preposition.

Re: OPT: Open Pre-trained Transformer Language Models

#127

Post by vladf »

ipaddr wrote: post #97
londons_explore wrote: post #80

Earlier quoted context omitted.

It's super easy to watermark weights for ML models. Just add a random 0.01 to a random weight anywhere in the network. It will have very little impact on the results, but will mean you can identify who leaked the weights.

Compare two copies.

Slightly modify a million random weights by changing the least significant bit up or down.

Re: OPT: Open Pre-trained Transformer Language Models

#128

Post by sigmoid10 »

d--b wrote: post #114

Remember when OpenAi wrote this? > Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT-2 along with sampling code. We are not releasing the dataset, training code, or GPT-2 model weights Well I guess Meta doesn’t care. https://openai.com/blog/better-language-models/

Ever since OpenAI transitioned away from the non-profit model, I'd take these statements with a grain if salt. Yes, there may also be some truth in that opinion, but don't underestimate monetary interests when someone has an easy ~12 month industry lead. Meta's existence and financial wellbeing on the other hand doesn't depend on this stuff, so they have less incentive to keep things proprietary. It seems ironic and almost bit sad that the new commercial circumstances have basically reversed these companies' original roles in AI research.

Re: OPT: Open Pre-trained Transformer Language Models

#130

Post by tsol »

Gigachad wrote: post #109
yosito wrote: post #62

Earlier quoted context omitted.

> OPT-175B has a high propensity to generate toxic language and reinforce harmful stereotypes So they trained it on Facebook comments?

I'd think any natural language model would have the same biases we see from real humans.

Are there really no moderated forums that the data can be taken from? Even HN-based training data would be much more civil
Post reply on HN