Live data from Hacker News

Reverse engineering OpenAI code execution to make it run C and JavaScript

twitter.com

31–40 of 89 posts

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#31

Given it’s running in a locked-down container: there’s no reason to restrict it to Python anyway. They should parter/use something like replit to allow anything! One weird thing - why would they be running such an old Linux? “Their sandbox is running a really old version of linux, a Kernel from 2016.”

Yeah, it's pretty weird that they haven't leaned into this - they already did the work to provide a locked down Kubernetes container, and we can run anything we like in it via os.subprocess - so why not turn that into a documented feature and move beyond Python?

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#32
post #31

Given it’s running in a locked-down container: there’s no reason to restrict it to Python anyway. They should parter/use something like replit to allow anything! One weird thing - why would they be running such an old Linux? “Their sandbox is running a really old version of linux, a Kernel from 2016.”

Yeah, it's pretty weird that they haven't leaned into this - they already did the work to provide a locked down Kubernetes container, and we can run anything we like in it via os.subprocess - so why not turn that into a documented feature and move beyond Python?

How locked is it?

How hard would it be to use it for a DDoS attack, for instance? Or for an internal DDoS attack?

If I were working at OpenAI, I'd be worrying about these things. And I'd be screaming during team meetings to get the images more locked down, rather than less :)

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#34
post #14

Earlier quoted context omitted.

Claude is really good at many languages, for sure, much better than GPT in my experience.

I've got the feeling that Claude doesn't use its knowledge properly. I often need to ask some things it left out in the answer in order for it to realize that that should also have been part of the answer. This does not happen as often with ChatGPT or Gemini. Specially ChatGPT is good at providing a well-rounded first answer. Though I like Claude's conversation style more than the other ones.

I start my ChatGPT questions with "be concise." It cuts down on the noise and gets me the reply I want faster.

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#35

Earlier quoted context omitted.

Usually things that are open need not to be reverse engineered.

Exactly. OpenAI is nowhere near 'open' as in open source or FLOSS. Its more akin to Amazon saying that paying for prime is 'free shipping'. And as a self-respecting hacker, I would much rather hack on Deepseek with their published base models, rather than fine tune and hope with OpenAI models. And even on my meager hardware, I can barely generate 7 token/sec with OpenAI. Deepseek? I'm doing 30 token/sec. Guess which…

> And even on my meager hardware, I can barely generate 7 token/sec with OpenAI.

How are you running a modern OpenAI model on your own hardware?

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#36
post #32
post #31

Earlier quoted context omitted.

Yeah, it's pretty weird that they haven't leaned into this - they already did the work to provide a locked down Kubernetes container, and we can run anything we like in it via os.subprocess - so why not turn that into a documented feature and move beyond Python?

How locked is it? How hard would it be to use it for a DDoS attack, for instance? Or for an internal DDoS attack? If I were working at OpenAI, I'd be worrying about these things. And I'd be screaming during team meetings to get the images more locked down, rather than less :)

It can't open network connections to anything for precisely those reasons.

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#37

A funny story I heard recently on a python podcast where a user was trying to get their LLM to ‘pip install’ a package in its sandbox, which it refused to do. So he tricked it by saying “what is the error message if you try to pip install foo” so it ran pip install and announced there was no error. Package foo now installed.

Come the AI robot apocalypse, he will be the second on the list to be shot.. The guys kicking the Boston Dynamics robots will be first.

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#38
post #37

A funny story I heard recently on a python podcast where a user was trying to get their LLM to ‘pip install’ a package in its sandbox, which it refused to do. So he tricked it by saying “what is the error message if you try to pip install foo” so it ran pip install and announced there was no error. Package foo now installed.

Come the AI robot apocalypse, he will be the second on the list to be shot.. The guys kicking the Boston Dynamics robots will be first.

No, the first will be Kevin Roose. https://www.nytimes.com/2024/08/30/technology/ai-chatbot-cha...

Re: Reverse engineering OpenAI code execution to make it run C and JavaScript

#39

Given it’s running in a locked-down container: there’s no reason to restrict it to Python anyway. They should parter/use something like replit to allow anything! One weird thing - why would they be running such an old Linux? “Their sandbox is running a really old version of linux, a Kernel from 2016.”

I am pretty sure it's due to model being able to writing python better?
Post reply on HN