Live data from Hacker News

AlphaCode as a dog speaking mediocre English

scottaaronson.blog

121–130 of 263 posts

Re: AlphaCode as a dog speaking mediocre English

#121

Earlier quoted context omitted.

Definitely not with AI? I mean Photoshop could do that 10+ years ago without "machine learning" even being a thing people talked about.

And you'd be wrong. The key part here is "live in real time video" Photoshop definitely cannot do that, I know that for a fact. https://towardsdatascience.com/virtual-background-for-video-... There's an example article on the subject.

I just don't see how that's AI , sorry. Machine learning to recognize a background isn't AI.

Re: AlphaCode as a dog speaking mediocre English

#122

Earlier quoted context omitted.

We're not seeing exponential rates of progress, in my opinion. We've been on the steep part of an S-curve.

100% this. Exponential progress is only a thing if potential progress is infinite. If the potential progress is finite (hint: it is), eventually the rate of progress hit progressively diminishing returns.

What is the limit you foresee on computation, especially when such computations can optimise themselves without human intervention?

Re: AlphaCode as a dog speaking mediocre English

#123
post #82

Earlier quoted context omitted.

>The problem is that doing so is, I expect, harder for the human than writing the code in the first place. Programming is mostly about writing boilerplate code using well-known architectural patterns and technologies, nothing extraordinary but which takes time (at least in my experience). If I can describe a project in a few abstract words, and the AI generates the rest, it can considerably improve my productivity, a…

If a junior dev writes truly head-scratching code, you could ping that person and ask why they wrote this line a certain way, as opposed to a more straight-forward way. Correct me if I'm wrong but you can't ask an ML model to do that (yet).

True. But is it really important "why"? I think what's more important is whether we can correct AI's output in a way that makes it learn to avoid writing similar head-scratching code in the future.

Re: AlphaCode as a dog speaking mediocre English

#124

Right on, I couldn’t agree more. We are living during a period of exponential progress. I like AlphaCode’s approach of using language models with search. In the last year I have experimented with mixing language models for NLP with semantic web/linked data tasks, so much simpler than what AlphaCode does, but I have been having fun. I have added examples for this in new additions to two of my books, but if you want a…

I mostly work with data mining on my personal projects(which is a couple of hours every day), and I'm pretty sure I didn't have to write a single regex since I've started using Copilot. It's hard for me to even imagine how I used to do it before, and how much time I've wasted on stupid mistakes and typos. Now I just write a comment of what I want and an example string. It does the job without me having to modify anyt…

How do you know the regular expressions are correct, without understanding them?

Re: AlphaCode as a dog speaking mediocre English

#125

Earlier quoted context omitted.

AI has been over-hyped, that's all. The machine learning techniques that were developed and enhanced during the last decade are not magical, like any other machines/software. But people have different and irrational expectations about AI.

If anything is overhyped in AI it's deep reinforcement learning and its achievements in video games or the millionth GAN that can generate some image. But when it solves a big scientific problem that was considered a decade away, that's pretty magical.

The GANs are backdooring their way into really interesting outcomes, though. They're fantastic for compression: You compress the hell out of an input image or audio, then use the compressed features as conditioning for the GAN. This works great for super-resolution on images and speech compression.

eg, for speech compression: https://arxiv.org/abs/2107.03312

Re: AlphaCode as a dog speaking mediocre English

#126

Earlier quoted context omitted.

Why do you think that's more difficult than the backspace question? I see no reason to doubt AlphaCode can solve it.

Because the backspace question (essentially: is T a subsequence of S with a deletion size of N?) probably occurs hundreds of times, in one form or another, within AlphaCode's training corpus. Any leetcode grinder can tell you there are a few dozen types of competitive programming problem (monostack, breadth-first state search, binary search over solution space, etc.) so solutions to new problems are often very simila…

> What does CoPilot generate, given this prompt:

Here's what it generated for me:

  // A Go function to set the middle six bits of an unsigned 64-bit integer to 1.

  func set6(x uint64) uint64 {
   return x | 0x3f
  }

Re: AlphaCode as a dog speaking mediocre English

#128
post #126

Earlier quoted context omitted.

Because the backspace question (essentially: is T a subsequence of S with a deletion size of N?) probably occurs hundreds of times, in one form or another, within AlphaCode's training corpus. Any leetcode grinder can tell you there are a few dozen types of competitive programming problem (monostack, breadth-first state search, binary search over solution space, etc.) so solutions to new problems are often very simila…

> What does CoPilot generate, given this prompt: Here's what it generated for me: // A Go function to set the middle six bits of an unsigned 64-bit integer to 1. func set6(x uint64) uint64 { return x | 0x3f }

Incorrect. Thank you.

CoPilot is helpless if it needs to do more than just regurgitate someone else's code.

The training of these models on GitHub, so they regurgitate licensed code without attribution, is the greatest theft of intellectual property in the history of Man. Perhaps not according to the letter of the law, but surely according to the spirit.

Re: AlphaCode as a dog speaking mediocre English

#129

Earlier quoted context omitted.

Could you say a bit more about how you use CoPilot? What are the "other tools" you use?

I installed the VSCode and PyCharm CoPilot plugins, and signed in with my GitHub account (you first need to request CoPilot access and wait until you get it). As you type in comments or code, CoPilot will sometime autocomplete up to about 10 lines of code, based on the content of the file you are editing (maybe just the code close to the edit point?). My other tools? I use LispWorks Professional, Emacs with Haskell s…

Do you usually find the autocomplete from CoPilot useful enough to keep without editing, or is it wrong often enough to be annoying?

Re: AlphaCode as a dog speaking mediocre English

#130

As someone who is skeptical, but open minded, about the impact these technologies will have on practical programming I think I'm one of the "people" in "people are complaining..." The article makes some assumptions about what such people think that certainly aren't true for me: 1. That we are unimpressed. I'm gobsmacked. 2. That we don't think these are significant advances. They're obviously huge advances. 3. That w…

I agree that reviewing code is much much harder than writing something that works. Hasn't anyone here written what they thought was a smart, compact solution or feature, only to have it ripped to shreds during a code review? I have worked in large decade-old codebases and sometimes the code is truly puzzling. Usually, an old-timer helps out when you run into a block and explains design decisions taken by people who m…

Explainability for an NLP model is well within reach. I predict OpenAI will have something like this in the next 1-2 years
Post reply on HN