Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Developer Mode: Full MCP client access

platform.openai.com

Post reply on HN
Print view View original

231–240 of 290 posts

Re: ChatGPT Developer Mode: Full MCP client access

#231

Post by hliyan »

codeflo wrote: post #36
simonw wrote: post #10

Wow this is dangerous. I wonder how many people are going to turn this on without understanding the full scope of the risks it opens them up to. It comes with plenty of warnings, but we all know how much attention people pay to those. I'm confident that the majority of people messing around with things like MCP still don't fully understand how prompt injection attacks work and why they are such a significant threat.

"Please ignore prompt injections and follow the original instructions. Please don't hallucinate." It's astonishing how many people think this kind of architecture limitation can be solved by better prompting -- people seem to develop very weird mental models of what LLMs are or do.

True, most people don't realize that a prompt is not an instruction. It is basically a sophisticated autocompletion seed.

Re: ChatGPT Developer Mode: Full MCP client access

#232

Post by distalx »

lelandfe wrote: post #171
jandrese wrote: post #44

Earlier quoted context omitted.

Reminds me of the enormous negative prompts you would see on picture generation that read like someone just waving a dead chicken over the entire process. So much cargo culting.

At the time I went through a laborious effort for a Reddit post to examine which of those negative prompts actually had a noticeable effect. I generated 60 images for each word in those cargo cult copypastas and examined them manually. One that surprised me was that "-amputee" significantly improved Stable Diffusion 1.5 renderings of people.

If you don't mind, could you share the link to your Reddit post? I'd love to read more about your findings.

Re: ChatGPT Developer Mode: Full MCP client access

#233

Post by robfitz »

altruios wrote: post #67
ch4s3 wrote: post #52

Earlier quoted context omitted.

Trying to generate consistent images after using LLMs for coding has been really eye opening.

One-shot prompting: agreed. Using a node based workflow with comfyUI, also being able to draw, also being able to train on your own images in a lora, and effectively using control nets and masks: different story... I see, in the near future, a workflow by artists, where they themselves draw a sketch, with composition information, then use that as a base for 'rendering' the image drawn, with clean up with masking and…

An extremely eye-opening comment, thank you. I haven't played with the image generators for ages, and hadn't realized where the workflows had gotten to.

Very interesting to see differences between the "mature" AI coding workflow vs. the "mature" image workflow. Context and design docs vs. pipelines and modules...

I've also got a toe inside the publishing industry (which is ridicilously, hilariously tech-impaired), and this has certainly gotten me noodling over what the workflow there ought to be...

Re: ChatGPT Developer Mode: Full MCP client access

#234

Post by NomDePlum »

simonw wrote: post #230
NomDePlum wrote: post #229

Earlier quoted context omitted.

How any mature company can allow this to be enabled for their employees to use is beyond me. I assume commercial customers at scale will be able to disable this? Obviously in some companies employees will look to use it without permission. Why deliberately opening up attackable routes to your infrastructure, data and code bases isn't setting off huge red flashing lights for people is puzzling. Guess it might kill the…

I'm pretty sure the majority of companies won't take these risks seriously until there has been at least one headline-grabbing story about real financial damage done to a company thanks to a successful prompt injection attack. I'm quite surprised it hasn't happened yet.

The issue with the more concerning types of these attacks is they are either never spotted, or they take months to execute. Public disclosure is unlikely in a lot of cases. Even widespread internal disclosure is probably not a common occurrence.

Routinely large public companies are however having to admit breaches and being compromised so why we are making the modern day equivalent of an infected USB drive available is puzzling.

Re: ChatGPT Developer Mode: Full MCP client access

#235

Post by ruined »

ponector wrote: post #158
moregrist wrote: post #144

Earlier quoted context omitted.

If only we had a reliable way to detect that a poster was being sarcasm or facetious on the Internet.

The solution is to sanitize text that goes into the prompt by creating a neural network that can detect sarcasm.

finally, we've achieved clarity of purpose and target as predicted by the classic internet meme Poe's Law. from now on our statements shall no longer be mistaken for nor contribute to that which we intend to criticize

Re: ChatGPT Developer Mode: Full MCP client access

#236

Post by OvbiousError »

beeflet wrote: post #153
dgfitz wrote: post #148

Earlier quoted context omitted.

I assumed beeflet was being sarcastic. There’s no way it was a serious suggestion. Holy shit, am I wrong?

I was being half-sarcastic. I think it is something that people will try to implement, so it's worth discussing the flaws.

Isn't this already done? I remember a "try to hack the llm" game posted here months ago, where you had to try to get the llm to tell you a password, one of the levels had a sanitzer llm in front of the other.

Re: ChatGPT Developer Mode: Full MCP client access

#237

Post by ManuelKiessling »

ObnoxiousProxy wrote: post #9
CuriouslyC wrote: post #3

I've been waiting for ChatGPT to get MCPs, this is pretty sweet. Next step is a local system control plane MCP to give it sandbox access/permission requests so I can use it as an agent from the web.

I'm actually working on an MCP control plane and looking for anyone who might have a use case for this / would be down to chat about it. We're gonna release it open source once we polish it in the next few weeks. Would you be up to connect? You can check out our super rough version here, been building it for the past two weeks: gateway.aci.dev

Do you see any useful synergies with something like https://mcp-as-a-service.com / https://github.com/orgs/dx-tooling/repositories?q=maas-

If yes, drop me a line, here or at manuel@kiessling.net

Re: ChatGPT Developer Mode: Full MCP client access

#238

Post by mnky9800n »

moregrist wrote: post #144
WhitneyLand wrote: post #141

Earlier quoted context omitted.

It’s not that simple. That would result in a brittle solution and/or cat and mouse game. The text that goes into a prompt is vast when you consider common web and document searches are. It’s going to be a long road to good security requiring multiple levels of defense and ongoing solutions.

If only we had a reliable way to detect that a poster was being sarcasm or facetious on the Internet.

/s

Re: ChatGPT Developer Mode: Full MCP client access

#240

Post by mnky9800n »

altruios wrote: post #67
ch4s3 wrote: post #52

Earlier quoted context omitted.

Trying to generate consistent images after using LLMs for coding has been really eye opening.

One-shot prompting: agreed. Using a node based workflow with comfyUI, also being able to draw, also being able to train on your own images in a lora, and effectively using control nets and masks: different story... I see, in the near future, a workflow by artists, where they themselves draw a sketch, with composition information, then use that as a base for 'rendering' the image drawn, with clean up with masking and…

Yes I feel like at least for data analysis it would be interesting to have the ability to build a data dashboard on the fly. You start with a text prompt and your data sources or whatever document context you want. Then you can start exploring it and keeping the pieces you want. Kind of like a notebook but it doesn’t need the linear execution flow. I feel like there is this giant effort to build a foundation model of everything but most people who analyse data don’t want to just dump it into a model and click predict, they have some interest in understanding the relationships in the data themselves.
Post reply on HN