AlphaCode Attention Visualization

"As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level. AlphaCode achieved an estimated rank within the top 54% of participants in programming competitions by solving new problems that require a combination of critical thinking, logic, algorithms, coding, and natural language understanding."

Re: AlphaCode Attention Visualization

#5

Post by tromp » Thu, Dec 08, 2022, 10:19 PM UTC

Will we ever see the day when AlphaIOCCC submits a winning entry?

Re: AlphaCode Attention Visualization

#6

Post by dang » Thu, Dec 08, 2022, 10:21 PM UTC

ladon86 wrote: post #2

For context on what this is, here is the associated blog post: https://www.deepmind.com/blog/competitive-programming-with-a...

One previous thread:

Competitive Programming with AlphaCode - https://news.ycombinator.com/item?id=30179549 - Feb 2022 (397 comments)

Re: AlphaCode Attention Visualization

#7

Post by jw1224 » Thu, Dec 08, 2022, 10:25 PM UTC

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware.

Normally I wouldn’t think too hard about this, but two things come to mind here:

Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use them yet?

Secondly (and perhaps this is clouding my judgment), the fact a Midjourney founder mentioned during an Office Hours session that [paraphrasing]: “it’s widely known in the industry that 90% of AI research is completely made-up garbage”…

[1] https://imagen.research.google/

[2] https://parti.research.google/

Re: AlphaCode Attention Visualization

#8

Post by [deleted] » Thu, Dec 08, 2022, 10:29 PM UTC

jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

[deleted]

Re: AlphaCode Attention Visualization

#9

Post by pifm_guy » Thu, Dec 08, 2022, 10:29 PM UTC

johnthuss wrote: post #4

"As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level. AlphaCode achieved an estimated rank within the top 54% of participants in programming competitions by solving new problems that require a combination of critical thinking, logic, algorithms, coding, and natural language understanding."

Worth noting that in many programming competitions online, a large chunk of competitors either don't submit anything, or only submit a little example.

Re: AlphaCode Attention Visualization

#10

Post by jiggawatts » Thu, Dec 08, 2022, 10:52 PM UTC

jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

The cultures at the various leading AI research organisations are wildly divergent.

Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or form.

OpenAI is full of boyscouts that think that AI should be carefully censored so that it represents black, brown, asian, and white people equally. They deliberately skew the training data to enshrine wokeness into the product, while also trying to prevent anyone using their models to generate anything vaguely like porn. Basically, they're digital mormons. No fun.

Stability AI / Stable Diffusion is a bunch of people that had money thrown at them with no guard rails. Anything goes. Download our models and have fun! Make porn if you want to. Whatever.

To nobody's surprise, only the latter is of any interest or use to the general public.

The sad part is that Google had the most resources to spend on training their models, and it's the least accessible.

It's like Tony Stark inventing cold fusion energy and then using only to power his suit instead of... you know... changing the world for the better.