Live data from Hacker News

Why I'm Lukewarm on Graph Neural Networks

singlelunch.com

1–10 of 50 posts

Re: Why I'm Lukewarm on Graph Neural Networks

#5
By no means I am an expert in deep learning, but lately I've been considering graph NNs snake oil of neural networks. There are no impressive results on any common tasks and that picture is supported by a recent paper claiming transformers to "contain a graph network inside".

Re: Why I'm Lukewarm on Graph Neural Networks

#7
post #5

By no means I am an expert in deep learning, but lately I've been considering graph NNs snake oil of neural networks. There are no impressive results on any common tasks and that picture is supported by a recent paper claiming transformers to "contain a graph network inside".

Graph NNs are widely used in the chemical domain -- molecules are easily modeled as graphs, so it's a natural fit.

Re: Why I'm Lukewarm on Graph Neural Networks

#8
post #7
post #5

By no means I am an expert in deep learning, but lately I've been considering graph NNs snake oil of neural networks. There are no impressive results on any common tasks and that picture is supported by a recent paper claiming transformers to "contain a graph network inside".

Graph NNs are widely used in the chemical domain -- molecules are easily modeled as graphs, so it's a natural fit.

So are graph embedding methods, which the post discusses

Re: Why I'm Lukewarm on Graph Neural Networks

#9
post #5

By no means I am an expert in deep learning, but lately I've been considering graph NNs snake oil of neural networks. There are no impressive results on any common tasks and that picture is supported by a recent paper claiming transformers to "contain a graph network inside".

In my opinion there aren't many deep learning applications that are fundamentally snake-oil, it's more that people who don't quite understand the limitations and advantages of particular methods that end up being (witting or unwitting) snake-oil salespeople.

Deep graph NN's are very useful for lots of data that are inherently graph-structured (another commenter above mentioned chemistry applications, and there are lots of other examples). Whether or not for the time-being they give SOTA results on common datasets, being able to work directly with graph-structured data is quite appealing in many cases.

Re: Why I'm Lukewarm on Graph Neural Networks

#10
post #8
post #7

Earlier quoted context omitted.

Graph NNs are widely used in the chemical domain -- molecules are easily modeled as graphs, so it's a natural fit.

So are graph embedding methods, which the post discusses

The post can't be accessed with a Internal Server Error. Or is it just my ISP? I often confuse myself with other representation learning methods such as graph kernels https://en.wikipedia.org/wiki/Graph_kernel

Are there any relations between them at all?

Post reply on HN