Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google Titans Model Explained: The Future of Memory-Driven AI Architectures

medium.com

Post reply on HN
Print view View original

21–30 of 37 posts

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#21

Post by PontifexMinimus »

bglazer wrote: post #7

This article gives off really strong chatgpt vibes. Bullet points! Confidently stated but quite vague statements! Integration, key innovations, more bullet points! Distinct lack of personal viewpoints or unique opinions! Very long! Maybe I’m being uncharitable and this is just the way things are written on Medium, but man this was not an easy or particularly enlightening read.

If true, it's got its grammar wrong:

>At its core, Titans merge two powerful mechanisms:

Should be "merges", since "Titans" as used here is a singular proper noun.

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#22

Post by thunderbird120 »

vessenes wrote: post #4

FWIW, Phil Wang (lucidrains) has been working on Titans reimplementation since roughly the day the paper was released. It looks to me from the repository that some of the paper's claims have not been reproduced yet, and reading between the lines, it might be Wang considers the paper to not be that groundbreaking after all -- hard to say definitively but the commit speed has definitely slowed down, and the last commen…

Yeah, that's the normal outcome for papers like this. Papers which claim to be groundbreaking improvements on Transformers universally aren't. Same story roughly once a month for the past 5 years.

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#23

Post by mmoskal »

nonfamous wrote: post #18

This is seemingly unrelated to the Amazon Titan foundational models available on Bedrock. As if things weren’t confusing enough with OpenAI’s naming scheme…

My favorites are Nvidia Triton (server) and Openai Triton (compiler)

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#25

Post by barbazoo »

cscurmudgeon wrote: post #20
ajcp wrote: post #3

> opening doors to innovations in AI-driven reasoning, healthcare, and beyond. You went with "healthcare"?

Mor businesses participating in health care should drive costs down.

Not if they’re additional middlepersons.

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#27

Post by the_arun »

sky2224 wrote: post #10
bglazer wrote: post #7

This article gives off really strong chatgpt vibes. Bullet points! Confidently stated but quite vague statements! Integration, key innovations, more bullet points! Distinct lack of personal viewpoints or unique opinions! Very long! Maybe I’m being uncharitable and this is just the way things are written on Medium, but man this was not an easy or particularly enlightening read.

Nah it's definitely AI generated. I used to like Medium a lot, but ever since AI Models became mainstream, it's just been a cesspool of horribly written articles.

So are they generating blog from arxiv papers?

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#28

Post by codelion »

vessenes wrote: post #4

FWIW, Phil Wang (lucidrains) has been working on Titans reimplementation since roughly the day the paper was released. It looks to me from the repository that some of the paper's claims have not been reproduced yet, and reading between the lines, it might be Wang considers the paper to not be that groundbreaking after all -- hard to say definitively but the commit speed has definitely slowed down, and the last commen…

It's a shame when potentially interesting papers don't hold up in practice. I've seen a few cases where the real-world performance didn't match the initial claims.

Re: Google Titans Model Explained: The Future of Memory-Driven AI Architectures

#29

Post by klipt »

llm_trw wrote: post #16
bloomingkales wrote: post #15

Earlier quoted context omitted.

To your own peril. Ignoring the stuff that comes out of Google caused Google itself harm. Some language is clickbait, some isn't. A Titan , that's a word if there ever was one. The Bitter Truth , a sentence if there ever was one. Language is a thing, and so I have to ask - why is language like this coming to these researchers? Off topic: Waymo is a verb, and Google owns it. The concept of AV will be overwhelmingly in…

I know they do good stuff, it's just the fire hose of bullshit is a lot wider than the tap of innovation.

True of most research as reported by the media https://phdcomics.com/comics/archive.php?comicid=1174
Post reply on HN