Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI API

beta.openai.com

Post reply on HN
Print view View original

101–110 of 165 posts

Re: OpenAI API

#101

Post by swyx »

minimaxir wrote: post #72
swyx wrote: post #67

Earlier quoted context omitted.

wow you just made the connection for me. GPT2 was too dangerous to release, and now GPT3 is so much better - is there no point at which things become too dangerous anymore? what was the conclusion on that one?

The blog post directly addresses this question: https://openai.com/blog/openai-api/ > What specifically will OpenAI do about misuse of the API, given what you’ve previously said about GPT-2? > We will terminate API access for use-cases that cause physical or mental harm to people, including but not limited to harassment, intentional deception, radicalization, astroturfing, or spam; as we gain more experience operatin…

ah i've been caught not reading the linked post

hmm i dont love this. either OpenAI has implicitly promised to monitor all its users, or has adopted a "report TOS violations to us when they happen and we will judge" stance. neither are great roads to go down.

Re: OpenAI API

#102

Post by bhl »

minimaxir wrote: post #72
swyx wrote: post #67

Earlier quoted context omitted.

wow you just made the connection for me. GPT2 was too dangerous to release, and now GPT3 is so much better - is there no point at which things become too dangerous anymore? what was the conclusion on that one?

The blog post directly addresses this question: https://openai.com/blog/openai-api/ > What specifically will OpenAI do about misuse of the API, given what you’ve previously said about GPT-2? > We will terminate API access for use-cases that cause physical or mental harm to people, including but not limited to harassment, intentional deception, radicalization, astroturfing, or spam; as we gain more experience operatin…

With Amazon having a moratorium of their rekognition API, I wonder if a Cambridge Analytica type event could happen to OpenAI where someone abuses and escapes the terms of service.

Re: OpenAI API

#103

Post by ganstyles »

grogenaut wrote: post #23
andyljones wrote: post #9

Concrete numbers from the various pullouts: > They saw ratings hover around 60% with their original, in-house tech — this improved by 7-8% with GPT-2 — and is now in the 80-90% range with the API. > The F1 score of its crisis classifier went up from .76 to .86, and the accuracy went up to 96%. > With OpenAI, Algolia was able to answer complex natural language questions accurately 4x as often as it was using BERT. I t…

$10m per training run gets me a lot of engineering time to build our own version of this system and lease it to other customers. Just skip one training run and I've got a pretty good team.

Putting aside the question of whether it would ever be a choice between spending $10M on a training run and hiring a team for $10M, GPT transformers were the end result of decades of language research and innovations. You’re making it sound as though you can build the next iteration past GPT-3 for $10M, which I don’t think is the case.

Re: OpenAI API

#104

Post by azinman2 »

dmvaldman wrote: post #100
azinman2 wrote: post #89

Earlier quoted context omitted.

Zero-shot learning is a way of essentially building classifiers. There's no reasoning, there's no planning, there's no commonsense knowledge (not in a comprehensive, deep way that we would look for it call it that), and there's no integration of these skills to solve common goals. You can't take GPT and say ok turn that into a robot that can clean my house, take care of my kids, cook dinner, and then be a great dinne…

I think this is generally a good answer, but keep in mind I said AGI "in text". My forecasting is that within 3 years you will be able to give arbitrary text commands and get the textual output of the equivalents of "clean my house, take care of my kids, ..." like problems. I also would contend that there is reasoning happening and that zero-shot demonstrates this. Specifically, reasoning about the intent of the prom…

Pattern recognition and matching isn’t the same thing as reasoning. Zero shot demonstrates reasoning as much as solving the quadratic equation for a new set of variables does; it’s simply the ability to create new decision boundaries leveraging the same set of classifying power and methodology. True agi isn’t bound to a medium — no one would say Helen Keller wasn’t intelligent for example.

I look forward to this ping :)

Re: OpenAI API

#105

Post by throwaway7281 »

eggsnbacon1 wrote: post #47

OpenAI started as a non-profit, went for-profit. Still owned by the big players.... Something isn't right. Is OpenAI just a submarine so the tech giants can do unethical research without taking blame??? Its textbook misdirection, nonprofit and "Open" in the name, hero-esque mission statement. How do you make the mental leap from "we're non-profit and we won't release things too dangerous" to "JK we're for-profit and…

When I learned that Sam Altman (sorry Sam) was involved, I understood the direction, you mentioned.

And yes, there is often no need to call something open explicitly, if it really is. Is into OpenOS, or just Linux?

Re: OpenAI API

#106

Post by gwern »

Barrin92 wrote: post #62
dmvaldman wrote: post #46

AGI in text is < 3yrs away.

there's zero understanding in any of this. This is still just superficial text parsing essentially. Show me progress on Winograd schema and I'd be impressed. It hasn't got anything to do with AGI, this is application of ML to very traditional NLP problems.

> Show me progress on Winograd schema and I'd be impressed.

The paper evaluated Winograds: https://arxiv.org/pdf/2005.14165.pdf#page=16

Re: OpenAI API

#107

Post by aivosha »

eggsnbacon1 wrote: post #93
sailingparrot wrote: post #73

Earlier quoted context omitted.

> so the tech giants can do unethical research I know it's trendy (and partly justified) to look down on OpenAI, but can you actually give any basis for this claim? What kind of research is OpenAI doing that all the other big AI players (Google/DeepMind, FB, Microsoft) aren't also invested in? And even if others are doing the same, what part of OpenAI's research do you consider unethical? > It may just be a conspirac…

> What kind of research is OpenAI doing that all the other big AI players (Google/DeepMind, FB, Microsoft) aren't also invested in? And even if others are doing the same, what part of OpenAI's research do you consider unethical? I believe all of them are doing unethical research, especially facial recognition. Notice the public backpedaling this week from all the big tech companies on this too. By directing their cas…

conspiracy hypothesis

Re: OpenAI API

#108

Post by aivosha »

eggsnbacon1 wrote: post #47

OpenAI started as a non-profit, went for-profit. Still owned by the big players.... Something isn't right. Is OpenAI just a submarine so the tech giants can do unethical research without taking blame??? Its textbook misdirection, nonprofit and "Open" in the name, hero-esque mission statement. How do you make the mental leap from "we're non-profit and we won't release things too dangerous" to "JK we're for-profit and…

More fake news and generated AI content there is more people would stop trusting social media. It will saturate to that tipping point that humanity will need to find more genuine ways to communicate. So I say bring it on.

Re: OpenAI API

#109

Post by wrsh07 »

eggsnbacon1 wrote: post #93
sailingparrot wrote: post #73

Earlier quoted context omitted.

> so the tech giants can do unethical research I know it's trendy (and partly justified) to look down on OpenAI, but can you actually give any basis for this claim? What kind of research is OpenAI doing that all the other big AI players (Google/DeepMind, FB, Microsoft) aren't also invested in? And even if others are doing the same, what part of OpenAI's research do you consider unethical? > It may just be a conspirac…

> What kind of research is OpenAI doing that all the other big AI players (Google/DeepMind, FB, Microsoft) aren't also invested in? And even if others are doing the same, what part of OpenAI's research do you consider unethical? I believe all of them are doing unethical research, especially facial recognition. Notice the public backpedaling this week from all the big tech companies on this too. By directing their cas…

Interestingly, by serving gpt3 as an API like this, they can actually monitor to see if companies are using it to generate spam

Re: OpenAI API

#110

Post by cercatrova »

azinman2 wrote: post #60
wildermuthn wrote: post #36

In one of their examples, they note “They saw ratings hover around 60% with their original, in-house tech — this improved by 7-8% with GPT-2 — and is now in the 80-90% range with the API.” Bloomberg reports the API is based on GPT-3 and “other language models”. If that’s true, this is a big deal, and it epitomizes OpenAI’s namesake. The largest NLP models require vast corporate resources to train, let alone put into…

It's only Open™️ if I can run the API on my own machines.

Run the model yourself and you can.
Post reply on HN