Perhaps I'm imagining it but the entire industry was build on published research, this "AI wave" is at odds with that and seems to be driven by greed (although they'll claim some arms race or something to help themselves sleep at night). There should be a new ESG (Environmental, Social, and Governance) policy being pushed recognizing the important role this plays. Although ESG and all norms have been set aside in thi…
> Perhaps I'm imagining it but the entire industry was build on public research There is some excellent publicly-funded research in there, but pivotal papers like Attention Is All You Need and the numerous pivotal OpenAI publications were privately funded. OpenAI is at the top of the chart in the study. I think you're bringing some assumptions into this conversation that aren't supported by the evidence.
AI's top startups are barely publishing their research
111–120 of 341 posts
Re: AI's top startups are barely publishing their research
#112Earlier quoted context omitted.
The article is complaining that research isn't peer reviewed and research is turning into blogs. I'm explaining why that's the best outcome possible and why in a field as hot as large dl models you won't even get that.
I thought parent post was saying that they didn't publish them at all after they had so much trouble with the journals. If they did publish the papers themselves then I don't see the problem. The article itself read to me as your standard journal rent seeking and I wasn't really responding to it.
To answer your question, sharing the research isn't the important part. These are researchers in the private sector, in a highly competitive field. Arguably, doing the research isn't the important part either. The important part is making money, and the research is a means to that end. Publishing the research doesn't further that goal, and, according to GP, it's so difficult that it may not be worthwhile trying.
Re: AI's top startups are barely publishing their research
#113"But University of Alberta AI ethicist Mohamed Abdalla says the findings reflect the incentives facing commercial AI developers, rather than solely a failure to uphold scientific norms. “It’s not the company’s job to advance science, right?” he says. “The company’s job is to advance money.”" ------------ If everyone holds back their publications, the whole sector moves slower. Yes, it's moving alarmingly fast accordi…
It may be moving so fast that they do not pay off, i.e. they get commoditized too fast. This all depends on Ai demand in the end. If you can keep the GPUs saturated (at a profitable rate), then it really shouldn't matter how much a token costs. If you bought too many GPUs, or paid to much for them in a hype cycle, you may need higher token prices to ROI than the market wants to pay given alternatives.
Re: AI's top startups are barely publishing their research
#114Re: AI's top startups are barely publishing their research
#115I can’t speak for other startups, but I applied to the most recent YC batch with my idea for making AI proactive instead of reactive, and pre-being selected I’ve published a paper on recursive self-improvement mapped to the Epoch AI data. I contacted a professor from a university in the UK and he responded since he was working on similar work, then asked me if I wanted to meet with him. We talked for about an hour si…
This is what happens to every field as it turns from a science into an industry. Chemists published freely until dyes started being worth money, and then the interesting work moved into company labs and stopped coming out.
Re: AI's top startups are barely publishing their research
#116Earlier quoted context omitted.
Sorry I mean published i.e. available to the public.
I was also referring to published papers available to the public. Like I said, I think you're bringing some assumptions to this conversation that aren't based on the how the industry came about.
Re: AI's top startups are barely publishing their research
#117Do they receive public funds?
How we wish to consider public funding and required sharing of gains is an open debate.
Re: AI's top startups are barely publishing their research
#118Earlier quoted context omitted.
> That and avoiding openAI and Anthropic copying our results and leaving us with nothing to show for six months of work. Isn't the POINT of publishing research because you want others to copy it?
For researchers, yes. For startups, no, because the point of that is to make money.
Re: AI's top startups are barely publishing their research
#119I don’t think Dario wants to be a monopolist. But history is full of brilliant people who focused on the social good as priority #1 and lost the game early.
Once you lose the game and go bankrupt you can’t do anything. Same as politics, if you’re not elected you can’t change anything. Of course there are many lines not worth crossing.
Re: AI's top startups are barely publishing their research
#120Earlier quoted context omitted.
Science is a method of inquiry, not an institution or group of people with titles.
Sure, but it is good that people actually adhere to that method if inquiry. They are not perfect, but institutions like peer review or universities do provide a framework and incentives for quality.