Live data from Hacker News

AI's top startups are barely publishing their research

science.org

41–50 of 341 posts

Re: AI's top startups are barely publishing their research

#41
post #38
post #27

Funny, as ONE PERSON with Claude, I've been on a tear when it comes to publishing my own research: https://arxiv.org/search/?searchtype=author&query=Magarshak%... So I know that smart people in those companies can definitely publish. In fact, a whole team should probably be publishing like no tomorrow!

Have you built the things described in those papers?

Yes, actually.

To be fair — from about half of the papers.

Re: AI's top startups are barely publishing their research

#43

Perhaps I'm imagining it but the entire industry was build on published research, this "AI wave" is at odds with that and seems to be driven by greed (although they'll claim some arms race or something to help themselves sleep at night). There should be a new ESG (Environmental, Social, and Governance) policy being pushed recognizing the important role this plays. Although ESG and all norms have been set aside in thi…

> Perhaps I'm imagining it but the entire industry was build on public research There is some excellent publicly-funded research in there, but pivotal papers like Attention Is All You Need and the numerous pivotal OpenAI publications were privately funded. OpenAI is at the top of the chart in the study. I think you're bringing some assumptions into this conversation that aren't supported by the evidence.

Sorry I mean published i.e. available to the public.

Re: AI's top startups are barely publishing their research

#44

Earlier quoted context omitted.

> Perhaps I'm imagining it but the entire industry was build on public research There is some excellent publicly-funded research in there, but pivotal papers like Attention Is All You Need and the numerous pivotal OpenAI publications were privately funded. OpenAI is at the top of the chart in the study. I think you're bringing some assumptions into this conversation that aren't supported by the evidence.

Sorry I mean published i.e. available to the public.

I was also referring to published papers available to the public.

Like I said, I think you're bringing some assumptions to this conversation that aren't based on the how the industry came about.

Re: AI's top startups are barely publishing their research

#45
post #30

What the blogificafion of AI research has done is allowed all kinds of claims and terminology related to AI to be introduced and taken up in a manner replicating social media dynamics. And that is simply not healthy. We’re fast reaching a place where any claim can be backed up with a set of numbers from a number of experiments run in some gamified environment or the other, with little concern for if it all adds up to…

How is that different from traditional research publication? It's faster?

No traditional research is mostly done by post-docs and have a phd level of education rather than a tech bro that passed leetcode. That seems like a good bar to have; not too mention the whole peer review thing, hard to really understand anything if you purposely withhold it and tell people to kick rocks.

Re: AI's top startups are barely publishing their research

#46

Earlier quoted context omitted.

Sorry I mean published i.e. available to the public.

I was also referring to published papers available to the public. Like I said, I think you're bringing some assumptions to this conversation that aren't based on the how the industry came about.

[deleted]

Re: AI's top startups are barely publishing their research

#47
There is no reason to publish anything in the AI era until you have reaped as much benefit from it as you are satisfied with. "Building in public" and "Researching in public" now means someone can swoop in with an AI and copy you instantly and become your competition overnight. Keep secrets.

Even at work, I have come to realize if I simply horde my accumulated custom AI built tools and productivity boosting tricks for myself, I can make myself more competitive as an employee.

I think this is how you get hired now, not by having a good resume, but by making claims of having special processes and personal tooling design that gets massive productivity ROI.

Re: AI's top startups are barely publishing their research

#48

The article is vague about the companies in the paper, for some reason. In the paper, OpenAI is at the top of the chart for cumulative citations. MEGVII, Hugging Face, Waymo, Momenta, Preferred Netowkrs, Anthropic, Owkin, and Databricks, and Aibee follow (in that order). Yes, that is citations, not publications, but they explain that they're trying to use that as a proxy for significance, albeit an imperfect one. Com…

databricks is a top ai startup?. i thought they did spark hosting or something. what makes them a top ai startup

$160 billion valuation and market capture among some top (non-AI, traditional enterprise) companies, I think.

Re: AI's top startups are barely publishing their research

#49
post #33

Earlier quoted context omitted.

Elon recently (2d) tweeted about making sure they preserve rare books and "scan them the hard way". That tweet launched a cultural wave of opposition regarding the debinding of rare books. The discussion has been around, but it's flared significantly recently. Not sure if that's what the person you're responding to is specifically inflamed about. Regardless, old/rare books are certainly being acquired and destroyed.

No, he didn't tweeted about "making sure" of anything. Elon tweeted "I’ve asked the SpaceXAI team to preserve any rare books in a library and scan them the hard way vs just cutting off the spine and scanning" which is no sense a credible source for what he actually asked SpaceXAI team to do, or if they are doing it, or what they were doing before yesterday. Elon has an extremely long and thorough track record of lyin…

Sure, I'm ambivalent to his veracity.

The problem remains either way. Small operations around the globe are debinding rare/unique books. I'm involved with an organization considering (not strongly) that exactly.

Re: AI's top startups are barely publishing their research

#50

Perhaps I'm imagining it but the entire industry was build on published research, this "AI wave" is at odds with that and seems to be driven by greed (although they'll claim some arms race or something to help themselves sleep at night). There should be a new ESG (Environmental, Social, and Governance) policy being pushed recognizing the important role this plays. Although ESG and all norms have been set aside in thi…

> Perhaps I'm imagining it but the entire industry was build on public research There is some excellent publicly-funded research in there, but pivotal papers like Attention Is All You Need and the numerous pivotal OpenAI publications were privately funded. OpenAI is at the top of the chart in the study. I think you're bringing some assumptions into this conversation that aren't supported by the evidence.

> OpenAI is at the top of the chart in the study.

A distinction should be made between the old nonprofit OpenAI and the current organization. They don't publish technical research anymore.

Post reply on HN