Live data from Hacker News

Claude Science

claude.com

11–20 of 199 posts

Re: Claude Science

#11
tl;dr: Use this if you don't like doing science or doing things well. It hallucinates references.

Seems to be based on https://github.com/swaruplab/operon as evidenced by the authorization dialog and https://x.com/testingcatalog/status/2037684573161783373 .

Mostly targeted at life sciences - e.g. integration for FDA, PubMed, genomics databases but no ACM / IEEE as far as I can tell.

Edit: arXiv search seems to be supported - but not Google Scholar etc. So, this tool is of little use for most researchers outside life sciences.

Edit 2: Quick walkthrough: the AppImage starts a browser window with an onboarding wizard and a chat interface. It suggests a few things one might do at the start of a research project - e.g. do a quick literature review. When I chose that option, wrote Python scripts that used MCP calls to do arXiv searches. Stayed seemingly stuck there for a few minutes not returning anything. Then:

> The free-text search returned too much noise

Claude decided to choose a certain paper as a starting point for further research. Shortly afterwards:

> That DOI resolved to the wrong paper. Let me find the correct anchor papers by title/author search directly.

Then it meandered a few more minutes doing research and creating a citation graph (that it did not show to me).

> I have a complete picture. Let me verify the key DOIs resolve and then write the review.

Then:

> The lint flags em-dash overuse. Let me reduce them, then save.

Then: a nice but verbose literature overview of my chosen topic

BUT it includes at least one hallucinated reference!

P.S.: What does this mean?

  [reviewer] verifier_mode=default-on downgraded to off: pro subscription tier, autoReviewer withheld (frame=f2a81cb2)

Re: Claude Science

#13
So it's like Claude Cowork for Science, i.e. for less tech-savvy users? I would imagine scientists with some coding background might just prefer to use Claude Code normally and integrate it with their stack of choice, but perhaps the comfort and ease of use of Claude Science still wins out.

Re: Claude Science

#14
post #5

Science isn’t suffering from a lack of papers. It’s suffering from a lack of good papers. Making it easier to just pump out paper-mill publications is about the last thing science needs right now.

Scientific research is suffering from a reproducibility crisis. Not a publication crisis. LLM's aren't going to solve reproducibility issues.

They're gonna worsen it

Re: Claude Science

#17
post #3

How about no? AI brand identity has made the unfortunate pivot to "how much do you trust us" which is going be a real race to the bottom. I don't want LLMs managing nuclear reactors or replacing junior lab technicians. I don't trust any of these LLMs to do the bare minimum, regardless of how good it is for your brand. It's gross watching these stunts unfold. Next ChatGPT will fly a passenger jet, which Claude will on…

Meanwhile in the real world, these Math Olympiad AIs can't even take your fast food order correctly.

Re: Claude Science

#18
post #7

maxed out on coding improvements so now they're trying to expand to other markets

Why have they talked about this for a long time? They predicted date of code maxing out, and did so not from fitting a sigmoid or something but they predicted it would max out right during a steep part of the slope?

Re: Claude Science

#19
post #5

Science isn’t suffering from a lack of papers. It’s suffering from a lack of good papers. Making it easier to just pump out paper-mill publications is about the last thing science needs right now.

Scientific research is suffering from a reproducibility crisis. Not a publication crisis. LLM's aren't going to solve reproducibility issues.

Por que no los dos? Scientific review times are up, it’s harder to find reviewers, and many reviews are AI generated anyway. Auto-generated research publications will arguably make the replication crisis worse, because there will be more slop to clog up the review system, and these papers will presumably be just as (if not more) not reproducible than human written science

Re: Claude Science

#20
When I saw "Science" I didn't think they meant Data Science, which is what the UIs full of pandas code and plots imply. Even if the focus is on the sciences, I suspect that's the less valuable part of the announcement particularly with the implication of Jupyter Notebook 2.0.

Image-understanding for data viz is a use case that has been ignored, and modern LLMs are getting better at proper EDA. But, uh, I may need to update my resume.

Post reply on HN