Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AlphaCode Attention Visualization

alphacode.deepmind.com

Post reply on HN
Print view View original

21–30 of 51 posts

Re: AlphaCode Attention Visualization

#21

Post by MrMan »

countvonbalzac wrote: post #14
jiggawatts wrote: post #10

Earlier quoted context omitted.

The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or f…

Not being horribly racist is woke now?

Yes - that is literally why “woke” is a pejorative term.

Re: AlphaCode Attention Visualization

#22

Post by [deleted] »

countvonbalzac wrote: post #14
jiggawatts wrote: post #10

Earlier quoted context omitted.

The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or f…

Not being horribly racist is woke now?

[deleted]

Re: AlphaCode Attention Visualization

#23

Post by sdenton4 »

pifm_guy wrote: post #9
johnthuss wrote: post #4

"As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level. AlphaCode achieved an estimated rank within the top 54% of participants in programming competitions by solving new problems that require a combination of critical thinking, logic, algorithms, coding, and natural language understanding."

Worth noting that in many programming competitions online, a large chunk of competitors either don't submit anything, or only submit a little example.

The real question is whether DeepMind can create a model which can outrun the goalposts.

Re: AlphaCode Attention Visualization

#24

Post by somrand0 »

jiggawatts wrote: post #10
jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or f…

what I'm interested in are the military-grade models they already have deployed against the russian and against the chinese. we're witnessing a war but cannot acknowledge it publicly.

Re: AlphaCode Attention Visualization

#25

Post by dougmwne »

lossolo wrote: post #18
jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

> Has Google/Alphabet publicly released any of their AI models yet? You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)? 1. https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert 2. https://arxiv.org/abs/2112.04426 3. https://arxiv.org/abs/1910.10683 code+mo…

Right, so that’s a no. Google releases research papers but can’t productize anything. They are like a modern day Xerox Parc.

Re: AlphaCode Attention Visualization

#26

Post by TaylorAlexander »

dougmwne wrote: post #25
lossolo wrote: post #18

Earlier quoted context omitted.

> Has Google/Alphabet publicly released any of their AI models yet? You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)? 1. https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert 2. https://arxiv.org/abs/2112.04426 3. https://arxiv.org/abs/1910.10683 code+mo…

Right, so that’s a no. Google releases research papers but can’t productize anything. They are like a modern day Xerox Parc.

I must be missing something. Did you see the GitHub links in the post you’re replying to?

Re: AlphaCode Attention Visualization

#27

Post by SeanAnderson »

TaylorAlexander wrote: post #26
dougmwne wrote: post #25

Earlier quoted context omitted.

Right, so that’s a no. Google releases research papers but can’t productize anything. They are like a modern day Xerox Parc.

I must be missing something. Did you see the GitHub links in the post you’re replying to?

Some of the commenters in this thread are remarking on the lack of functional examples that they can interact with and others are saying they feel the existence of published technical papers is sufficient. They're talking through each other a bit.

Re: AlphaCode Attention Visualization

#28

Post by typon »

lossolo wrote: post #18
jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

> Has Google/Alphabet publicly released any of their AI models yet? You mean NLP field changing models from Google like BERT [1]? or Transformers paper [2]? or T5 model [3] (used by company doing ChatGPT like search currently on the front page on HN)? 1. https://arxiv.org/abs/1810.04805 code+models: https://github.com/google-research/bert 2. https://arxiv.org/abs/2112.04426 3. https://arxiv.org/abs/1910.10683 code+mo…

I read a lot on Twitter about the so-called "culture" of Google that prevents them from making AI based products, meanwhile OpenAI has made ChatGPT and is going to replace Google search within the next two months or so. I think this is the same narrative that's being expressed by the GP comment.

To add to your comment, Google has been using BERT to power Search since 2019: https://blog.google/products/search/search-language-understa...

I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?

Re: AlphaCode Attention Visualization

#29

Post by slaucon »

somrand0 wrote: post #24
jiggawatts wrote: post #10

Earlier quoted context omitted.

The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or f…

what I'm interested in are the military-grade models they already have deployed against the russian and against the chinese. we're witnessing a war but cannot acknowledge it publicly.

what do you mean by this? how are they being deployed? disinformation campaigns or more than that?

Re: AlphaCode Attention Visualization

#30

Post by ldjkfkdsjnv »

jw1224 wrote: post #7

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use t…

I cannot wait for the true downfall of Google. Many friends I have had began working there and fell into a blackhole of arrogance. Meanwhile, nothing from a technical perspective, aside from BERT, has been contributed by them in quite a while. Their technical open source (Tensorflow, Angular, Kubernetes) has all followed the same pattern of overly complex garbage. Facebook opensource (Pytorch, React) blows the doors off Google open source.

And exactly, where are the models? Where is the AI? Bert came out what 5 years ago?

Its certainly not in Search given how unusable the results are. They are busy using models to structure everyones content so they can display it on the Search page and capture value from content they didn't create

Not one mind blowing AI product from them. The results of OpenAI are exposing FAANGs as has beens

Post reply on HN