Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API

beta.openai.com

Post reply on HN
Print view View original

121–130 of 165 posts

Re: OpenAI API

#121

Post by organicfigs »

JoeAltmaier wrote: post #120
organicfigs wrote: post #113

On a side note, has anyone noticed a lack of diversity on the group photo on their careers page: https://openai.com/content/images/2020/04/openai-offsite-jul... I remember coming across it not too long ago and felt unwelcomed/disappointed.

I dunno - looks fairly representative of the Silicon Valley population demographic. Maybe not so much an issue with this company? I notice (as usual) under-representation of women. But that's endemic to the industry.

To an extent I agree that most startups are made up of Caucasians/Chinese males, I think one of the reasons I left tech professionally is because I didn't feel comfortable/enjoy the lack of diversity.

Re: OpenAI API

#122

Post by organicfigs »

freediver wrote: post #118
organicfigs wrote: post #113

On a side note, has anyone noticed a lack of diversity on the group photo on their careers page: https://openai.com/content/images/2020/04/openai-offsite-jul... I remember coming across it not too long ago and felt unwelcomed/disappointed.

Define diversity?

fwiw my best friends are SE Asian (not Chinese), white, black, and Mexican. I didn't feel this photo is as equally representative of that diversity. I'm not making a case it has any obligation to do so, just noting that it impacted my decision to not apply here a while ago.

Re: OpenAI API

#123

Post by seph-reed »

cercatrova wrote: post #117
seph-reed wrote: post #83

Earlier quoted context omitted.

> sitting on the technological equivalent of a mountain of gold. What would you do? Greed is not justified. I get that people are weak, selfish, they can't stop themselves. Some feel sympathy because they've been weak too. "Maybe it's justified," they like to think. "Everybody lies." But seriously, those who care so much about money and power they can't do things in a civilized respectable way: they are not yet an ad…

Why is it not justified, beyond a moral belief? Seems rational that people would strive to make as much money as possible.

Rational is building community. Rational is searching for inner peace. Rational is being the best you can, and helping others.

Greed is not rational. It's just rationalized.

Re: OpenAI API

#124

Post by markchen90 »

Yajirobe wrote: post #75
dna_polymerase wrote: post #56

Earlier quoted context omitted.

Have a look at this discussion and the article from earlier today [0]. Of course, a singular lab could compete with something DeepMind does, but not without massive amounts of money in their pockets. The state of the art has become pretty expensive, really fast. [0]: https://news.ycombinator.com/item?id=23486163

State of the art can be (and usually is) born in academic labs.

I don't think this is true. The ResNet was born at Microsoft, DQN was born at Deepmind, the Transformer was born at Google, and GPT2 was born at OpenAI.

I'm obviously biased since I work at an industry AI lab, but we both have important roles to play.

Re: OpenAI API

#125

Post by d_burfoot »

In NLP there is a very clear and powerful new paradigm: train a HUGE language model using vast amounts of raw text. Then to solve the problem of interest, either fine-tune the model by training on your specific dataset (usually quite small), or 0/1-shot the learning somehow.

The crucial question is : is this paradigm viable for OTHER types of data?

My hypothesis is YES. If you train a HUGE image model using vast quantities of raw images, you will then be able to REUSE that model to work for specific computer vision problems, either by fine-tuning or 0/1-shotting.

I'm especially optimistic that this paradigm will work for image streams from autonomous vehicles. Classic supervised learning has proved to be difficult if not impossible to get to work for AV vision, so the new paradigm could be a game-changer.

Re: OpenAI API

#126

Post by gwern »

d_burfoot wrote: post #125

In NLP there is a very clear and powerful new paradigm: train a HUGE language model using vast amounts of raw text. Then to solve the problem of interest, either fine-tune the model by training on your specific dataset (usually quite small), or 0/1-shot the learning somehow. The crucial question is : is this paradigm viable for OTHER types of data? My hypothesis is YES. If you train a HUGE image model using vast quan…

> My hypothesis is YES. If you train a HUGE image model using vast quantities of raw images, you will then be able to REUSE that model to work for specific computer vision problems, either by fine-tuning or 0/1-shotting.

This has been demonstrated for many years, it's not news. Many of the SOTAs like BiT require pretraining on JFT-300M, or Instagram, or what have you.

Re: OpenAI API

#127

Post by gwern »

minimaxir wrote: post #35

Since the demos on this page use zero-shot learning and the used model has a 2020-05-03 timestamp, that implies this API is using some form of GPT-3: https://news.ycombinator.com/item?id=23345379 (EDIT: the accompanying blog post confirms that: https://openai.com/blog/openai-api/ ) Recently, OpenAI set the GPT-3 GitHub repo to read-only: https://github.com/openai/gpt-3 Taken together, this seems to imply that GPT-3 w…

It's worth noting that at least one of the demos is not few-shot: the code completion one notes it was trained on Github.

Re: OpenAI API

#128

Post by freediver »

organicfigs wrote: post #122
freediver wrote: post #118

Earlier quoted context omitted.

Define diversity?

fwiw my best friends are SE Asian (not Chinese), white, black, and Mexican. I didn't feel this photo is as equally representative of that diversity. I'm not making a case it has any obligation to do so, just noting that it impacted my decision to not apply here a while ago.

If it had people of different color of skin but all men, would that bother you (no women)? Or if it had different color of skin but all of them were Christian? ( no other religions) Or different color of skin but all Canadians would that bother you? (No other nationalities)

As a European I am much more used to diversity meaning national or religious diversity. Still getting used to this notion of it mainly been used in the context of skin color in US.

Re: OpenAI API

#129

Post by jaimex2 »

"OpenAI technology, just an HTTPS call away"

'an' is only mean to proceed a vowel. Should say

"OpenAI technology, just a HTTPS call away"

Re: OpenAI API

#130

Post by chad_oliver »

jaimex2 wrote: post #129

"OpenAI technology, just an HTTPS call away" 'an' is only mean to proceed a vowel. Should say "OpenAI technology, just a HTTPS call away"

This depends how you pronounce 'h'. If you pronounce it "aitch", then "an HTTPS" is correct. If you pronounce it "haitch", then "a HTTPS" is correct. There's no universal pronunciation, and therefore no universally-right answer.
Post reply on HN