Live data from Hacker News

AI's top startups are barely publishing their research

science.org

71–80 of 341 posts

Re: AI's top startups are barely publishing their research

#71
post #2

Yet none of them would have been here if Google hadn't published "Attention is all you need", the irony.

Even Google wouldn't be here.

It was kind of like radiation science before WWII, it would be freely published because it wasn't potentially world changing yet. After it became a government interest, even people doing things unrelated to weapons would be much more apt to hold their work close.

Re: AI's top startups are barely publishing their research

#72
post #2

Yet none of them would have been here if Google hadn't published "Attention is all you need", the irony.

Oh that built on a bunch of ideas that weren’t far off. It was a great discovery but like many it’s standing in tall shoulders

Re: AI's top startups are barely publishing their research

#73
post #66

I've been at two startups that have done genuine world first fundamental research. The first tried to publish novel results for 3 years in tier 1 journals before finally doing a preprint and telling the tier one publishers to jump in a fire. The second, and ongoing, isn't publishing anything because of my experience with the first. That and avoiding openAI and Anthropic copying our results and leaving us with nothing…

Can you share a link to the preprint?

Re: AI's top startups are barely publishing their research

#74
post #66

I've been at two startups that have done genuine world first fundamental research. The first tried to publish novel results for 3 years in tier 1 journals before finally doing a preprint and telling the tier one publishers to jump in a fire. The second, and ongoing, isn't publishing anything because of my experience with the first. That and avoiding openAI and Anthropic copying our results and leaving us with nothing…

Why wouldn't they just skip the journals and publish the papers themselves? Sharing the research is the important part unless these are academics who are trying to get tenure, grants or such.

Re: AI's top startups are barely publishing their research

#75

Perhaps I'm imagining it but the entire industry was build on published research, this "AI wave" is at odds with that and seems to be driven by greed (although they'll claim some arms race or something to help themselves sleep at night). There should be a new ESG (Environmental, Social, and Governance) policy being pushed recognizing the important role this plays. Although ESG and all norms have been set aside in thi…

[dead]

Re: AI's top startups are barely publishing their research

#76

What the blogificafion of AI research has done is allowed all kinds of claims and terminology related to AI to be introduced and taken up in a manner replicating social media dynamics. And that is simply not healthy. We’re fast reaching a place where any claim can be backed up with a set of numbers from a number of experiments run in some gamified environment or the other, with little concern for if it all adds up to…

> We’re fast reaching...

We already arrived at that destination a decade ago.

Probably even further back tbh.

There's just a lot more people playing the game now, without the social indoctrination that made it more tolerable in some circles.

It's not that bad, though. September is annoying but you kind of miss the eternal renewal once you're out.

Re: AI's top startups are barely publishing their research

#77

Do startups in other fields constantly publish their research?

That was my first thought. In my experience, particularly with trading firms (the ones doing real science based prediction trading, not TA bullshit) do not publish ANYTHING at all, and haven't for 40+ years.

Think Renaissance Technologies or similar.

Re: AI's top startups are barely publishing their research

#78
post #66

I've been at two startups that have done genuine world first fundamental research. The first tried to publish novel results for 3 years in tier 1 journals before finally doing a preprint and telling the tier one publishers to jump in a fire. The second, and ongoing, isn't publishing anything because of my experience with the first. That and avoiding openAI and Anthropic copying our results and leaving us with nothing…

Can you share a link to the preprint?

https://www.biorxiv.org/content/10.1101/2021.12.02.471005v2....

Re: AI's top startups are barely publishing their research

#79
post #51

Earlier quoted context omitted.

> Perhaps I'm imagining it You are not. A disproportionate amount of value in the computing industry was created by geniuses decently smart people who worked together and who decided to just tell people how to do things instead of trying to capture the value of being the first person to figure out how to do those things. This observation pre-dates the current wave of AI hype by a half century or so. > driven by greed…

Let me help rewrite your first paragraph: * A disproportionate amount of value in the computing industry was created by g̶e̶n̶i̶u̶s̶e̶s̶ decently smart people who worked together to do things that seemed impossible and who decided to just tell people how to do things instead of trying to capture the value of being the first person to figure out how to do those things.*

thx for notes; no complaints on my end.

edit: edited.

Re: AI's top startups are barely publishing their research

#80
post #66

I've been at two startups that have done genuine world first fundamental research. The first tried to publish novel results for 3 years in tier 1 journals before finally doing a preprint and telling the tier one publishers to jump in a fire. The second, and ongoing, isn't publishing anything because of my experience with the first. That and avoiding openAI and Anthropic copying our results and leaving us with nothing…

Why wouldn't they just skip the journals and publish the papers themselves? Sharing the research is the important part unless these are academics who are trying to get tenure, grants or such.

The article is complaining that research isn't peer reviewed and research is turning into blogs. I'm explaining why that's the best outcome possible and why in a field as hot as large dl models you won't even get that.
Post reply on HN