Live data from Hacker News

CheatGPT

blog.humphd.org

431–440 of 544 posts

Re: CheatGPT

#431
post #323

Earlier quoted context omitted.

> "What's the weirdest bug you debugged? What made it weird?" If you can remember, 5-10 years after you solved it.

It doesn't have to be true though, it just has to be a nice story. And this is the kind of interview questions you can prepare.

> It doesn't have to be true though ...

This is exactly why it's a bad question.

Re: CheatGPT

#432

Earlier quoted context omitted.

> "What's the weirdest bug you debugged? What made it weird?" If you can remember, 5-10 years after you solved it.

Me to ChatGPT: reply to this interview question "What's the weirdest bug you debugged? What made it weird?" in first-person, make it a personal story. ChatGPT: It was early on in my career as a software developer, and I was working on a web application that was designed to allow users to upload images and apply filters to them. One day, a user reported a strange issue where some of the filters were producing unexpect…

ChatGPT can clearly get through job interviews, but can it also actually do the job?

Re: CheatGPT

#433
post #324

Earlier quoted context omitted.

As a first year grad student, I had a professor in material science who gave the same assignments and mostly same exams every year. Of course a) I didn't know this b) using previous works was prohibited c) cheating was rampant. I only found this out after getting heavily marked down on the first HW and joining a study group which was moderately chaste (eg only used the answers to check our work before turning it in).…

Learning over the centuries has always taken a character of reciting information, since the ability to do so was valued at the time. With the technologies of today, the ability to recite knowledge (versus using said knowledge when provided, and the ability to look for said knowledge) is rapidly losing value. But our education system has not moved on and are mostly stuck at using recital to judge student capability. A…

I got my first degree in 2009. Recently started again. Took a biology test today and was pleasantly surprised how non-recital it was.

It focused on a planned development (hotels, grocery stores, etc) in a part of town that everybody in the class is quite familiar with and asked us to apply concepts from lecture to predict the impact to a given set of species.

It was masterful. Hit all the points, anchored in our everyday lives, applied in a way that rote memorization just wouldn't help with. I had a moment like: WTF I've lived here my whole life and never seen a wild ferret. Searched it after the test and turns out they're native and critically endangered.

Just saying: the good ones are out there.

Re: CheatGPT

#434
post #397
post #348

Earlier quoted context omitted.

“People are getting tripped up because they are seeing legitimate intelligence in the output from these systems -- but that intelligence was in the people who wrote the texts that it was trained with, not in the LLM.” This is the real magic. Let’s train ChatGPT on absolute garbage information and compare the intelligence of the two.

Let's take a kid and teach them garbage information as they are growing up... minimize as much 'real knowledge' as possible and see what comes out.

Right. There are various examples of what growing up isolated does to your mind.

Intelligence comes from a mix of the universe's stream of data hammering your senses and the teachings of another previous intelligent being.

There's nothing fundamentally wrong in kickstarting a chatbot with lots of pretrained data. It’s Chinese Rooms all the way down.

Re: CheatGPT

#435
post #428
post #363

Earlier quoted context omitted.

I'm proposing a device that pretends to be a keyboard, and mimics typing in the code

And a counter for that could be a laptop device with the usb ports disabled. A lot of this stuff is solved with some basic IT imo.

You're now well past the original proposal of a Raspberry Pi. And people who need different input devices for ergonomic reasons (laptops keyboards are not a good fit for many people) are going to push back hard.

The device can make network connections, right? Someone's going to come up with a very short program you can type by hand, compile, and then pull down arbitrary other code over the network.

Re: CheatGPT

#436

Earlier quoted context omitted.

You can use this for that: https://huggingface.co/spaces/JavaFXpert/Chat-GPT-LangChain (GPT + WolframAlpha + Whisper)

I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")

>turns out, the latest version of chatGPT knows the answer

"Knows" as in "this exact formulation is present in many thousands of webpages and books in its corpus" x)

Re: CheatGPT

#437

Earlier quoted context omitted.

I tested several AI chats, and none of them could correctly answer the question: "what is heavier, 1 kilogram of nails or 1 kilogram of feathers?". Does this one know? (I don't have openai key, can't test it myself). EDIT: turns out, the latest version of chatGPT knows the answer. They also fixed the answer to another famous trick question("The son of my father, but not my brother. Who is that?")

It does not. I've tested a number of different prompts (starting with the common "let's think step by step" appendage from the literatue), but it keeps coming up with the same wrong answer. I finally broke down and started arguing with it. Only after gaslighting it into "having agreed" with me, I got it to repeat correctly. (By the way this is not chatgpt but just the gpt3.5 model, I find it easier to work with, not…

That's just hilarious. My brief experiments with chatgpt followed similar patterns

Me: Can you tell me X

GPT: The answer is Y

Me: No it's not, that's obviously wrong because Z, don't you think?

GPT: Yes I was mistaken, the answer is Y1 [still wrong]

Me: No it's not, that's obviously wrong because Z1, don't you think?

....

GPT: Yes I was mistaken, the answer is Yn [finally correct]

Re: CheatGPT

#438

I don't understand how most of the comments here seem to be along the lines of "these interview questions are useless now" or "we need to rethink education, it hasn't kept up". These all seem absurdly myopic to me. What we're seeing is the first instance, still very limited and imperfect, of AGI. This is not going to make some interview questions obsolete, or give students more tools to cheat with their homework. It…

> I can't even picture a functional world where humans are cut out of most professions that don't involve manual work

Many people do manual work. It may very well be the case that general fine motor skills are a far more complex and difficult operation than the entire edifice of human intellect. Philosophically, it would be an immense blow, the mother of all existential crises. But regardless, it suggests that the first AGI would be incapable of independent survival and we'd still be relevant and in control for a while.

> where any amount of acquired knowledge and skills will be surpassed by machines that can produce better results at a thousandth of the cost in a thousandth of the time a human can.

I don't think we can necessarily extrapolate it to be that cheap. It could be. But it is also possible that the increases in cost and resources to scale these models bigger and bigger will outstrip hardware progress and that this technology will run into a dead end. To put it differently, I think it is far from clear that the kind of hardware that we build is actually better than an organic substrate for this sort of computation. Imagine an optimized organic neural implementation of ChatGPT, for instance. Would it be slower or more expensive than ChatGPT? Perhaps not. Likewise, the very best that the current paradigm can offer may not be faster or cheaper than humans are at quite many valuable tasks.

Re: CheatGPT

#439
post #398
post #296

Earlier quoted context omitted.

To be completely ridiculous, we'll have AGI when it can convince a human to mate with it over any other human followed by raising its offspring to a successful adulthood. This is the game we're all playing.

Parasites are also lifeforms. It doesn't have to convince you to breed, it has to convince you to keep it plugged in and feeding ever increasing amounts or computing power. In theory GPT is there with the right prompt.

>It doesn't have to convince you to breed, it has to convince you to keep it plugged in and feeding ever increasing amounts or computing power.

It's already succeeding at that.

Re: CheatGPT

#440

I don't understand how most of the comments here seem to be along the lines of "these interview questions are useless now" or "we need to rethink education, it hasn't kept up". These all seem absurdly myopic to me. What we're seeing is the first instance, still very limited and imperfect, of AGI. This is not going to make some interview questions obsolete, or give students more tools to cheat with their homework. It…

> What we're seeing is the first instance, still very limited and imperfect, of AGI. None of this is AGI. This is Eliza on steroids.

It seems disingenuous to say that this is Eliza on steroids. They operate in fundamentally different ways, no?

I definitely agree with the premise that the current state of the art isn't at all AGI, but it seems almost self-evident to me that LLMs are a key piece of the puzzle on the road to AGI. Eliza was never going to have that kind of trajectory, but LLMs I think you could certainly make that argument for.

Post reply on HN