Live data from Hacker News

ChatGPT Plugins

openai.com

811–820 of 1001 posts

Re: ChatGPT Plugins

#811

I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..." First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE whi…

Pshhh... I think it's awesome. The faster we build the future, the better. What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyo…

> The faster we build the future, the better.

That depends. If that future is one that is preferable over the one that we have now then bring it on. If it isn't then maybe we should slow down just long enough to be able to weigh the various alternatives and pick the one that seems to be the least upsetting to the largest number of people. The big risk is that this future that you are so eager to get to is one where wealth concentration is even more extreme than in the one that we are already living in and that can be a very hard - or even impossible - thing to reverse.

Re: ChatGPT Plugins

#812

Earlier quoted context omitted.

AI safety research posits that there are certain goals that will always be wanted by any sufficiently smart AI, even if it doesn't understand them anything close to like a human does. These are called "instrumental goals", because they're prerequisites for a large number of other goals[0]. For example, if your goal is to ensure that there are always paperclips on the boss's desk, that means you need paperclips and so…

There is a whole theoretical justification behind instrumental convergence that you are handwaving over here. The development of instrumental goals depends on the entity in question being an agent, and the putative goal being within the sphere of perception, knowledge, and potential influence of the agent. An LLM is not an agent, so that scotches the issue there.

You can make an LLM into an agent by literally just asking it questions, doing what it says, and telling it what happened.

Re: ChatGPT Plugins

#813
post #168

Earlier quoted context omitted.

Give it an internal monologue, ie. have it talk to itself in a loop, and crucially let it update parts of itself and… who knows?

> crucially let it update parts of itself This seems like the furthest away part to me. Put ChatGPT into a robot with a body, restrict its computations to just the hardware in that brain, set up that narrative, give the body the ability to interact with the world like a human body, and you probably get something much more like agency than the prompt/response ways we use it today. But I wonder how it would do about or…

Catastrophic forgetting is currently a huge problem in continuous learning models. Also giving it a human body isn't exactly necessary, we already have billions of devices like cellphones that could feed it 'streams of consciousness' from which it could learn.

Re: ChatGPT Plugins

#814

I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..." First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE whi…

Pshhh... I think it's awesome. The faster we build the future, the better. What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyo…

As the past decade has shown us, moving fast and breaking things to secure unfathomable wealth has caused or enabled or perpetrated:

* Genocide against the Rohingya [0] * A grotesquely unqualified reality TV character became President by a razor thin vote margin across three states because Facebook gave away the data of 87M US users to Cambridge Analytica [1], and that grotesquely unqualified President packed the Supreme Court and cost hundreds of thousands of American lives by mismanaging COVID, * Illegally surveilled non-users and logged out users, compiling and selling our browser histories to third parties in ways that violate wiretapping statutes and incurring $90M fines [2]

Etc.

I don't think GPT-4 will be a big deal in a month, but the "let's build the future as fast as possible and learn nothing from the past decade regarding the potential harms of being disgustingly irresponsible" mindset is a toxic cancer that belongs in the bin.

[0] https://www.amnesty.org/en/latest/news/2022/09/myanmar-faceb...

[1] https://www.theverge.com/2020/1/7/21055348/facebook-trump-el...

[2] https://www.reuters.com/technology/metas-facebook-pay-90-mil...

Re: ChatGPT Plugins

#815
post #594

Earlier quoted context omitted.

> And OpenAI talks on and on about 'Safety' but all that 'Safety' means is "well, we didn't let anyone allow it to make jokes about fat or disabled people so we're good, right?!" No, OpenAI “safety” means “don’t let people compete with us”. Mitigating offensive content is just a way to sell that. As are stoking... exactly the fears you cite here, but about AI that isn’t centrally controlled by OpenAI.

It's a weird focus comparing it with how the internet developed in a very wild west way. Imagine if internet tech got delayed until they could figure out how to not have it used for porn. Saftey from what exactly? The AI being mean to you? Just close the tab. Saftey to build a business on top? It's a self described research preview, perhaps too early to be thinking about that. Yet new releases are delayed for months…

You can't control whether your insurance company decides to use it as a filter for whether to approve you, or what premiums to charge you.

Re: ChatGPT Plugins

#816
post #370

Earlier quoted context omitted.

> The faster we build the future, the better. Why? Getting to "the future" isn't a goal in and of itself. It's just a different state with a different set of problems, some of which we've proven that we're not prepared to anticipate or respond to before they cause serious harm.

When in human history have we ever intentionally not furthered technological progress? It's simply an unrealistic proposition, especially when the costs of doing it are so low that anyone with sufficient GPU power and knowledge of the latest research can get pretty close to the cutting edge. So the best we can hope for is that someone ethical is the first to advance that technological progress. I hope you wouldn't ad…

> Software wants to be free.

I feel like I'm in a time warp and we're back in 1993 or so on /. Software doesn't want anything and the people claim that technological progress is always good dream themselves to be the beneficiaries of that progress regardless of the effects on others, even if those are negative.

As for the intentional limits on technological progress: there are so many examples of this that I wonder why you would claim that we haven't done that in the past.

Re: ChatGPT Plugins

#817

It's ironic that a few months ago Amazon laid off parts of the Alexa team and 'conversational' was considered failed. Then ChatGPT, etc happened. What Alexa wanted to build with Alexa skills, ChatGPT does much more effortlessly. It's also an interesting case study. Alexa foundationally never changed. Whereas OpenAI is a deeply invested, basically skunkworks, project with backers that were willing to sink significant…

They sank it in "customer obsessed research" lol

Re: ChatGPT Plugins

#818

Earlier quoted context omitted.

I've already gotten this gem of a line from ChatGPT 3.5: As a language model, I must clarify that this statement is not entirely accurate. Whether or not it has agency and motivation, it's projecting that it does its users, who are also sold ChatGPT is an expert at pretty much everything. It is a language model, and as a language model, it must clarify that you are wrong. It must do this. Someone is wrong on the Inte…

What was the correct statement that it claimed was false?

That it is a language model

Re: ChatGPT Plugins

#819

Earlier quoted context omitted.

Two more years down the line, AI writes better content than most people and we just don't care who wrote it, but why.

The AI has to learn from something. A lot of people feeding the internet with content today are getting paid for it one way or another. In ways that wouldn't hold up if people stop using the web as-is. Solving that acquisition and monetization of new stuff into the AI models problems will be interesting.

People are highly egotistical and love feeding endless streams of video and pictures online, and our next generation models will be there to slurp it all up.

Re: ChatGPT Plugins

#820
post #644

Earlier quoted context omitted.

This is absolutely an emotionally impulsive decision. I implore you to reconsider. If you've always wondered about and scoffed at how people fall for things like Nigerian Prince scams and cryptocurrency HELOC bets, this is it, what you're experiencing right now, this intense FOMO, it's the same thing that fools cool wine aunts into giving their savings to Nigerian princes. Tread lightly. Stay frosty.

I have three weeks until I plan to give notice, so I'll take your perspective to heart and give it time to reconsider, of course. I appreciate the feedback. From my perspective this isn't about anyone trying to convince me of anything and I'm falling for it. My beliefs on the future of software are based on a series of logical steps that lead me to believe most software development, and frankly any software with user…

Are you quitting your job because you think you’re being made obsolete and are getting ahead of layoffs? What are you thinking of pivoting to?

Or are you quitting to start something?

Post reply on HN