Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OPT: Open Pre-trained Transformer Language Models

arxiv.org

Post reply on HN
Print view View original

91–100 of 242 posts

Re: OPT: Open Pre-trained Transformer Language Models

#91

Post by daenz »

astrange wrote: post #84
daenz wrote: post #75

Earlier quoted context omitted.

In the same way we can train models that can identify people from their choice of words, phrasing, grammar, etc, we can train models that identify other models.

That's anthropomorphizing them - a large language model doesn't have a bottleneck the same way a human does (in terms of being able to express things), it can get on a path where it just outputs memorized text directly and it won't be consistent with what it usually seems to know at all. Also, you could break a discriminator model by running a filter over the output that changes a few words around or misspells things…

I agree it is not exactly the same as a human, but the content it produces is based on its specific training data, how it was fed the training data, how long it was trained, the size and shape of the network, etc. These are unique characteristics of a model that directly impact what it produces. A model could have a unique proclivity for using specific groups of words, for example.

But yes, you could break the discriminator model, in the same way people disguise their own writing patterns by using synonyms, making different grammar/syntax choices, etc. Building a better evader and building a better detector is an eternal cat and mouse game, but it doesn't reduce the need to participate in this game.

Re: OPT: Open Pre-trained Transformer Language Models

#92

Post by mtlmtlmtlmtl »

sanxiyn wrote: post #74
nomilk wrote: post #12

Earlier quoted context omitted.

> to corner the market first Is Meta's model going to be open source or paid?

The linked paper makes it clear it will be released under a non-commercial license. You will download it gratis (so it won't be paid), but it won't be open source.

So they make a more available alternative, but they maintain control over it, and in turn gain control over the people and companies using it. Similar to what Microsoft did by bundling Windows with PCs[1].

I already have a multitude of ideas on potential nefarious plans based on this, but I'll keep them to myself.

[1]: Sure they got a licence payment, but since it was built into the price and non-optional, it was effectively equivalent to free from the customer POV. It effectively became a tax. I have to admit, Gates might not be a genius programmer but he sure knows how to design dark patterns :)

Re: OPT: Open Pre-trained Transformer Language Models

#93

Post by lumost »

zarzavat wrote: post #89
lumost wrote: post #37

I often wonder if OpenAIs decision not to open gpt-3 was because it was to expensive to train relative to its real value. They’ve hidden the model behind an api where they can filter out most of the dumb behaviors, while everyone believes they are working on something entirely different.

Didn’t they sell an exclusive license to Microsoft? It’s probably just a contractural issue.

That happened after they decided not to release the model.

Re: OPT: Open Pre-trained Transformer Language Models

#94

Post by MengerSponge »

yosito wrote: post #62
thorum wrote: post #31

A quick summary of the Limitations section: - "OPT-175B does not work well with declarative instructions or point-blank interrogatives." - "OPT-175B also tends to be repetitive and can easily get stuck in a loop. While sampling can reduce the incidence rate of repetitive behavior (Holtzman et al., 2020), we anecdotally found it did not eliminate it entirely when only one generation is sampled." - "We also find OPT-17…

> OPT-175B has a high propensity to generate toxic language and reinforce harmful stereotypes So they trained it on Facebook comments?

Does it merely reinforce harmful stereotypes? Or will it help perpetrate genocide?

Re: OPT: Open Pre-trained Transformer Language Models

#95

Post by daenz »

jrockway wrote: post #88
voz_ wrote: post #55

Earlier quoted context omitted.

> I will never discuss FB technical details, internals, or anything else on this site, so please do not ask. My claim of nonsense has nothing to do with FB. You cannot fingerprint models like this, that's just not how it works. Also, if we are reading profiles, you call yourself a 10x engineer on your blog, that's hilarious. Maybe 10x the nonsense?

Please don't start a profile analysis flamewar. It just escalates and makes everyone unhappy. I think it's OK if people notice you work at Facebook. There are people on HN that like to attack anyone nice enough to engage with them just because they work at a big company. I worked at Google for many years, and people were off to blame me personally for every decision that Google made that they didn't like. My approach…

To be clear, I wasn't intending to come across as attacking voz, only pointing out that I don't think anyone "in the know" at Meta/Facebook would admit to it even if they were doing it, so hearing "This is nonsense." doesn't really tell anybody much. They would likely say the same thing whether they thought it was nonsense or not.

Re: OPT: Open Pre-trained Transformer Language Models

#96

Post by ad_hominem »

VectorLock wrote: post #69
ad_hominem wrote: post #56

Earlier quoted context omitted.

> Pushshift.io Reddit corpus Pushshift is a single person with some very strong political opinions who has specifically used his datasets to attack political opponents. Frankly I wouldn't trust his data to be untainted. These models really need to be trained on more official data sources, or at least something with some type of multi-party oversight rather than data that effectively fell off the back of a truck. edit…

Thats interesting, any good sources for this accusation?

Not handy, and I'm not going to spend my evening digging. It may've also been one of the NGOs ideologically aligned with him that credited him for the data + assistance

Re: OPT: Open Pre-trained Transformer Language Models

#97

Post by ipaddr »

londons_explore wrote: post #80
bogwog wrote: post #77

Earlier quoted context omitted.

That is dumb when you consider that this thing is likely going to leak anyways. It’s inevitable, and when it does happen, it will just end up in the hands of criminals/scammers and not the general public.

It's super easy to watermark weights for ML models. Just add a random 0.01 to a random weight anywhere in the network. It will have very little impact on the results, but will mean you can identify who leaked the weights.

Compare two copies.

Re: OPT: Open Pre-trained Transformer Language Models

#98

Post by voz_ »

jrockway wrote: post #88
voz_ wrote: post #55

Earlier quoted context omitted.

> I will never discuss FB technical details, internals, or anything else on this site, so please do not ask. My claim of nonsense has nothing to do with FB. You cannot fingerprint models like this, that's just not how it works. Also, if we are reading profiles, you call yourself a 10x engineer on your blog, that's hilarious. Maybe 10x the nonsense?

Please don't start a profile analysis flamewar. It just escalates and makes everyone unhappy. I think it's OK if people notice you work at Facebook. There are people on HN that like to attack anyone nice enough to engage with them just because they work at a big company. I worked at Google for many years, and people were off to blame me personally for every decision that Google made that they didn't like. My approach…

That's a good point, and a valid correction. Thank you!

Re: OPT: Open Pre-trained Transformer Language Models

#99

Post by rdedev »

mikolajw wrote: post #42

The big one, OPT-175B, isn't an open model. The word "open" in technology means that everyone has equal access (viz. "open source software" and "open source hardware"). The article says that research access will be provided upon request for "academic researchers; those affiliated with organizations in government, civil society, and academia; and those in industry research laboratories.". Don't assume any good intent…

I'm afraid of companies pushing large scale models as the end all for anything text related. Large language models are revolutionary but the last thing I want to see is everything being run through an API. I'm more interested in things like knowledge distillation or prompt tuning. The hope is that a medium size model with some training can match a large one large one using zero shot approaches

Re: OPT: Open Pre-trained Transformer Language Models

#100

Post by alar44 »

ALittleLight wrote: post #5
MasterScrat wrote: post #2

"We are releasing all of our models between 125M and 30B parameters, and will provide full research access to OPT-175B upon request. Access will be granted to academic researchers; those affiliated with organizations in government, civil society, and academia; and those in industry research laboratories." GPT-3 Davinci ("the" GPT-3) is 175B. The repository will be open "First thing in AM" ( https://twitter.com/stephe…

I don't like "available on request". I just want to download it and see if I can get it to run and mess around with it a bit. Why do I have to request anything? And I'm not an academic or researcher, so will they accept my random request? I'm also curious to know what the minimum requirements are to get this to run in inference mode.

Gimme gimme. I want all your research and man hours for free. Gimme gimme.

They are a for profit company and don't need to release anything. It's not that hard to understand.

Post reply on HN