Looks like OpenAI is going head to head with huggingface. This makes a lot of sense and it seems they are telegraphing to monetize what they have been doing. It also seems like this is why they don't release their models in a timely manner.
The notable difference is that the base Huggingface library is open source, so you could in theory build something similar or more custom to the OpenAI API internally (which then falls into the typical cost/benefit analysis of doing so).
OpenAI API
71–80 of 165 posts
Re: OpenAI API
#72OpenAI started as a non-profit, went for-profit. Still owned by the big players.... Something isn't right. Is OpenAI just a submarine so the tech giants can do unethical research without taking blame??? Its textbook misdirection, nonprofit and "Open" in the name, hero-esque mission statement. How do you make the mental leap from "we're non-profit and we won't release things too dangerous" to "JK we're for-profit and…
wow you just made the connection for me. GPT2 was too dangerous to release, and now GPT3 is so much better - is there no point at which things become too dangerous anymore? what was the conclusion on that one?
> What specifically will OpenAI do about misuse of the API, given what you’ve previously said about GPT-2?
> We will terminate API access for use-cases that cause physical or mental harm to people, including but not limited to harassment, intentional deception, radicalization, astroturfing, or spam; as we gain more experience operating the API in practice we expect to expand and refine these categories.
Re: OpenAI API
#73OpenAI started as a non-profit, went for-profit. Still owned by the big players.... Something isn't right. Is OpenAI just a submarine so the tech giants can do unethical research without taking blame??? Its textbook misdirection, nonprofit and "Open" in the name, hero-esque mission statement. How do you make the mental leap from "we're non-profit and we won't release things too dangerous" to "JK we're for-profit and…
I know it's trendy (and partly justified) to look down on OpenAI, but can you actually give any basis for this claim?
What kind of research is OpenAI doing that all the other big AI players (Google/DeepMind, FB, Microsoft) aren't also invested in? And even if others are doing the same, what part of OpenAI's research do you consider unethical?
> It may just be a conspiracy theory
Yea, it very much looks like that to be honest.
Re: OpenAI API
#74OpenAI started as a non-profit, went for-profit. Still owned by the big players.... Something isn't right. Is OpenAI just a submarine so the tech giants can do unethical research without taking blame??? Its textbook misdirection, nonprofit and "Open" in the name, hero-esque mission statement. How do you make the mental leap from "we're non-profit and we won't release things too dangerous" to "JK we're for-profit and…
I could get poems to generate well. Tweets were a bit harder but I don't think we are at the point where you could just use a generative model to fool people that would be cheaper than actually hiring someone to write fake news. (Also shameless plug below)
[1] 1400 - TALK.8 - "A way to make fake tweets using GPT2" - Joshua Jay Herman https://thotcon.org/schedule.html
Re: OpenAI API
#75Earlier quoted context omitted.
Why is it "impossible"? Academic labs are non-profit, and they are also effectively trying "to compete" with DeepMind.
Have a look at this discussion and the article from earlier today [0]. Of course, a singular lab could compete with something DeepMind does, but not without massive amounts of money in their pockets. The state of the art has become pretty expensive, really fast. [0]: https://news.ycombinator.com/item?id=23486163
Re: OpenAI API
#76OpenAI started off wide-eyed and idealistic but it made the mistake of taking on investors for a non-profit mission. A non-profit requires sponsors, not investors. Investors have a fiduciary responsibility to maximize profits, not achieve social missions of open AI for all.
Re: OpenAI API
#77Re: OpenAI API
#78Earlier quoted context omitted.
What breakthrough occurred?
Zero shot and few-shot learning in GPT-3 and lack of significant diminishing returns in scaling text models. Zero-shot learning is equivalent to saying "i'm just going to ask the model something that it was not trained to do"
Re: OpenAI API
#79AGI in text is < 3yrs away.
there's zero understanding in any of this. This is still just superficial text parsing essentially. Show me progress on Winograd schema and I'd be impressed. It hasn't got anything to do with AGI, this is application of ML to very traditional NLP problems.
Re: OpenAI API
#80Earlier quoted context omitted.
wow you just made the connection for me. GPT2 was too dangerous to release, and now GPT3 is so much better - is there no point at which things become too dangerous anymore? what was the conclusion on that one?
GPT2 being "too dangerous to release" was a marketing stunt from the very beginning.