Live data from Hacker News

TIL you can de-obfuscate code with ChatGPT

twitter.com

21–30 of 111 posts

Re: TIL you can de-obfuscate code with ChatGPT

#21
post #12

Every commenter is jumping in asking “is it correct?” Even if it’s not 100%, if it’s at least reasonably close, it could be a tremendous force-multiplier against obfuscation for someone with some familiarity with roughly what the code is trying to do.

the input was generated by chatgpt. and is non-functional.

so, ROUGHLY, what is it trying to do?

Re: TIL you can de-obfuscate code with ChatGPT

#22
post #10

i would rather ask it to give me the python source of a program capable to deobfuscate THAT string. anything else is just naive, wishfull thinking and a waste of time. you will have to deobfuscate the code manually anyways but at least you got on HN EDIT: OMG... the obfuscated code was generated by chatgpt AND DOESNT EVEN WORK

Are you just now realizing these LLM’s can’t factually determine if what they output is correct?

Re: TIL you can de-obfuscate code with ChatGPT

#23
post #10

i would rather ask it to give me the python source of a program capable to deobfuscate THAT string. anything else is just naive, wishfull thinking and a waste of time. you will have to deobfuscate the code manually anyways but at least you got on HN EDIT: OMG... the obfuscated code was generated by chatgpt AND DOESNT EVEN WORK

Are you just now realizing these LLM’s can’t factually determine if what they output is correct?

no, i am just now realizing what a clout hero alex is

Re: TIL you can de-obfuscate code with ChatGPT

#25

Is it correct though? I’ve been toying around with ChatGPT for a few weeks now and I encountered a few situations in which ChatGPT was like 90% accurate at best. Things like suggesting snippets of configuration files or plugin research. It’s good to get an idea and get started somewhere, but I certainly cannot trust it blindly.

Define accurate?

It's just like any other AI system, it returns results as a best effort proposition of accurate with a % confidence that doesn't map well to binary outcomes.

So yes, it can be accurate. But there are scenarios where it must be strict or binary correct, and its not great at that bit.

Re: TIL you can de-obfuscate code with ChatGPT

#26

Is it correct though? I’ve been toying around with ChatGPT for a few weeks now and I encountered a few situations in which ChatGPT was like 90% accurate at best. Things like suggesting snippets of configuration files or plugin research. It’s good to get an idea and get started somewhere, but I certainly cannot trust it blindly.

Don't think so. There's clearly the beginning of a while loop near the top of the obfuscated version. There's no loops at all in the 'de-obfuscated' version.

Here's GPT's own explanation what the purpose of that while loop is:

---

This code uses JavaScript's `eval` function to obfuscate the code by looping over an array of strings and passing them as arguments to `eval` to create a variable. It also uses an anonymous function to obfuscate the code. The code is deobfuscated by replacing the `eval` function and the anonymous function with their respective strings.

Re: TIL you can de-obfuscate code with ChatGPT

#29
post #25

Is it correct though? I’ve been toying around with ChatGPT for a few weeks now and I encountered a few situations in which ChatGPT was like 90% accurate at best. Things like suggesting snippets of configuration files or plugin research. It’s good to get an idea and get started somewhere, but I certainly cannot trust it blindly.

Define accurate? It's just like any other AI system, it returns results as a best effort proposition of accurate with a % confidence that doesn't map well to binary outcomes. So yes, it can be accurate. But there are scenarios where it must be strict or binary correct, and its not great at that bit.

I’ve had it confidently tell me to use Python libraries that don’t exist, pass parameters to methods that aren’t in the method signature, and to write code that had to be debugged and fixed.

I’m still excited to use it, but you have to know enough about coding to ensure correctness. It’s no where near possible for a non-coder to build a complicated app with (so far).

Re: TIL you can de-obfuscate code with ChatGPT

#30
I have to say, I find all the comments dismissing ChatGPT hilarious. I read them in a funny grandpa voice. However, we should look past the insignificant details. The main achievement is that we now have a really capable unstructured text-to-computer interface. We can hook it up to anything and it will give us answers with whatever properties we desire, in whatever shape we can think of.
Post reply on HN