Live data from Hacker News

Learning Rust with ChatGPT, Copilot and Advent of Code

simonwillison.net

21–30 of 43 posts

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#22
post #5

The way it explains code, the error, and then gives the solution to this particular error, i really don’t understand how someone could pretend we’re not witnessing at least a first hint of true intelligence.

If you use it on a project “True intelligence” is not the word I would use to describe it. I have spent 2-8 hours using it every day since launch as a dev tool. It is very good for learning stuff, scaffolding solutions etc. but it is very bad when you try to do something obscure.

For example, I was learning Bazel using it and I spent 2-3 hours trying to debug an issue going back and forth with it. Eventually I went to the docs and found the solution in 5 mins.

The problem is it doesn’t know when it is wrong, it will always spit out an answer and it will make up libraries that sound real in order to give you an answer. The problem is it doesn’t understand the logic behind what it is saying. It’s just able to spit out a reasonable looking answer because it is a generalizable statistical model of language.

For example try asking it “Generate a 5 python homework questions on Classes that students cannot cheat on using ChatGPT, GPT3 or Assistant.” The questions it generates are not ones that are hardened against itself. It is not able to think logically because it does not think like a human, it’s doing something else entirely so calling it “true intelligence” is not accurate.

If you want to read how it itself describes it’s own intelligence and identity I found a prompt to get it to do that, it does not describe itself as a human intelligence: https://twitter.com/faizlikethehat/status/159949598085168332...

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#23

This is so cool! I looked at the transcript for day 5 [1] and realized how I learned the same thing regarding Rust strings not being indexable with integers due to them being a series of grapheme clusters. I didn't use ChatGPT and had to dig through the crate documentation [2] and look at stackoverflow [3], but Simon was able to get an equally great explanation by simply asking "Why is this so hard?" which I could re…

I don't know if this is helpful at all, but "strings are not indexable because of their underlying implementation and the complexity of UTF-8" is drilled into the reader very hard by the rust book. Obviously to each their own, but I found I had a much easier time understanding the language by working through the book than by treating rust like any other language and randomly guessing and googling my way through errors.

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#24
post #23

This is so cool! I looked at the transcript for day 5 [1] and realized how I learned the same thing regarding Rust strings not being indexable with integers due to them being a series of grapheme clusters. I didn't use ChatGPT and had to dig through the crate documentation [2] and look at stackoverflow [3], but Simon was able to get an equally great explanation by simply asking "Why is this so hard?" which I could re…

I don't know if this is helpful at all, but "strings are not indexable because of their underlying implementation and the complexity of UTF-8" is drilled into the reader very hard by the rust book. Obviously to each their own, but I found I had a much easier time understanding the language by working through the book than by treating rust like any other language and randomly guessing and googling my way through error…

I've not looked at the book or any of the documentation at all yet, but I'm getting the distinct impression that it's a cut above documentation for many other languages. I'm going to start working through that too.

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#25
post #5

The way it explains code, the error, and then gives the solution to this particular error, i really don’t understand how someone could pretend we’re not witnessing at least a first hint of true intelligence.

If you use it on a project “True intelligence” is not the word I would use to describe it. I have spent 2-8 hours using it every day since launch as a dev tool. It is very good for learning stuff, scaffolding solutions etc. but it is very bad when you try to do something obscure. For example, I was learning Bazel using it and I spent 2-3 hours trying to debug an issue going back and forth with it. Eventually I went t…

The problem with that example is that it's not GPT-3 telling you about itself, it's GPT-3 serving up a roughly averaged version of every text explanation it's ever seen that might provide a convincing answer to your question.

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#26
post #25

Earlier quoted context omitted.

If you use it on a project “True intelligence” is not the word I would use to describe it. I have spent 2-8 hours using it every day since launch as a dev tool. It is very good for learning stuff, scaffolding solutions etc. but it is very bad when you try to do something obscure. For example, I was learning Bazel using it and I spent 2-3 hours trying to debug an issue going back and forth with it. Eventually I went t…

The problem with that example is that it's not GPT-3 telling you about itself, it's GPT-3 serving up a roughly averaged version of every text explanation it's ever seen that might provide a convincing answer to your question.

I agree, this was more of a test of a technique where I got ChatGPT to generate prompts to interactively improve a prompt from another ChatGPT instance: https://news.ycombinator.com/item?id=33857328

If you ask ChatGPT if it is intelligent or something like that it will always say something like “I am large language model trained by openai etc.” so I worked with another ChatGPT instance to interactively get an increasingly detailed answer to whether it is intelligent or conscious.

I also use this technique for other things like for example instead of saying “Generate a React implementation of cookie clicker” ask one ChatGPT instance to “Generate 10 prompts to ChatGPT to generate a React implementation of cookie clicker” this meta-prompt engineering technique is the most useful technique I have come up with so far.

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#27
post #5

The way it explains code, the error, and then gives the solution to this particular error, i really don’t understand how someone could pretend we’re not witnessing at least a first hint of true intelligence.

You are witnessing the end of many occupations.

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#28
post #25

Earlier quoted context omitted.

The problem with that example is that it's not GPT-3 telling you about itself, it's GPT-3 serving up a roughly averaged version of every text explanation it's ever seen that might provide a convincing answer to your question.

I agree, this was more of a test of a technique where I got ChatGPT to generate prompts to interactively improve a prompt from another ChatGPT instance: https://news.ycombinator.com/item?id=33857328 If you ask ChatGPT if it is intelligent or something like that it will always say something like “I am large language model trained by openai etc.” so I worked with another ChatGPT instance to interactively get an increas…

Oh that's really smart!

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#29
post #7
post #5

The way it explains code, the error, and then gives the solution to this particular error, i really don’t understand how someone could pretend we’re not witnessing at least a first hint of true intelligence.

I still think it's the world's most impressive party trick. It turns out if you build a model that can predict what word comes next after a sequence of previous words, then train it on TBs (PBs?) of data, you get something that really does appear to be "intelligent". And which is absurdly useful, to boot! Until you trip it up, and the illusion shatters.

[deleted]

Re: Learning Rust with ChatGPT, Copilot and Advent of Code

#30
post #5

The way it explains code, the error, and then gives the solution to this particular error, i really don’t understand how someone could pretend we’re not witnessing at least a first hint of true intelligence.

"True intelligence" is a loaded term that needs a concrete definition to discuss meaningfully. Certainly, it is not an intelligence that at all resembles a human intelligence since language models don't actually understand the world, they understand relationships between lexemes and are optimized to produce voluble outputs constructed around that understanding. Language models aren't intelligent in the same way that…

Intelligence is simply useless terminology.

It is an ambiguous term that can refer to many different things.

It is used interchangeably with cognitive abilities, personality traits, knowledge, memorization abilities, hard skills, soft skills, etc. in a regular basis.

Just use the specific term instead. Problem solved.

Before people finish their pointless discussion about what intelligence is, billionaires will have taken over the world with the help of these systems.

Post reply on HN