Live data from Hacker News

Scite: Smart Citations for Better Research

scite.ai

1–10 of 18 posts

Re: Scite: Smart Citations for Better Research

#2
On the tech side, this looks nice. But one thing people don't seem to take seriously enough is:

If you're doing science and you don't know the literature, then you're doing a bad job.

Understanding a paper won't work by reading AI summaries. Finding surprising new papers in your field should be very rare even without tech.

[edit] Let me re-phrase the very negative statement above. There are a couple of important tasks in working with literature.

One is finding cumulative truth, i.e. figuring out the overall state of research. This should be done in a true meta-analysis of the data, since references are sometimes citing articles incorrectly (i.e. claiming something that's not in the paper) and the linguistic complexity is enormous. Meta-analyes are a lot of manual work, even though you can extract some data from standardized tables.

Another one is figuring out what new publications there are on a specific subject. Search engines like google scholar are immensely useful here, because you can follow the reference tree in both directions (citing and cited). This tool would help, but perhaps incrementally so (not a panacea).

A third task would be to identify novel interesting papers that you didn't know about, perhaps from a different field. This tool might help, but only if an unknown interesting paper cites something you're looking at (i.e. if the networks are not disjoint).

Apart from that, offering structural analyses and visualizations of science is something I believe should be done with open source and open data, because science is about trust and transparency - now more than ever.

Re: Scite: Smart Citations for Better Research

#4
post #3

That name has just been burnt into my mind to stand for the Scintilla Text Editor: https://www.scintilla.org/SciTE.html Amazing how this is still getting releases after 20+ years.

Yeah, I assumed by the title, SciTE added a feature to help with citations.

Re: Scite: Smart Citations for Better Research

#5

On the tech side, this looks nice. But one thing people don't seem to take seriously enough is: If you're doing science and you don't know the literature, then you're doing a bad job. Understanding a paper won't work by reading AI summaries. Finding surprising new papers in your field should be very rare even without tech. [edit] Let me re-phrase the very negative statement above. There are a couple of important task…

Hi,

Thanks for the thoughtful response.

Disclaimer: I work at scite.

I want to clarify one point in your comment because I know a lot of people read HN comments before clicking through: we do NOT offer AI summaries!

scite is fundamentally built on the idea that not all citations are equal. We offer disambiguation into citations by extracting the in-text contexts when citations happen between two papers. With that, you can qualitatively see how a paper has been cited by others by seeing the citation contexts from each citing paper.

As someone who used to be in research before at the National Cancer Institute, I certainly agree that scientists who are advanced in their field should know the literature inside out.

But the utility of scite is I think quite a bit more than that:

- If you're an expert scientist, you can configure alerts to know when new citations happen to papers that you care about (e.g. ones you published, or that are important in your field, etc). Except unlike Google Scholar alerts and such, you can now immediately see the citation contexts (as opposed to opening up each paper, and trying to locate the reference(s) and the in-text citations).

- If you're a student or an experienced researcher trying to ramp up in a new field (which is increasingly important given how interdisciplinary science is these days), this is a useful tool in your arsenal to digest and discover new papers.

- That last comment also applies if you are in the industry! e.g. someone in pharma doing drug discovery or evaluation and you're working on different drugs every months.

We do have a preprint we published if you'd like to read more about how scite works: https://www.biorxiv.org/content/10.1101/2021.03.15.435418v1

I hope that was clear. I'm happy to answer any other questions. I'll try to come back and check periodically.

- Ashish

Re: Scite: Smart Citations for Better Research

#6

On the tech side, this looks nice. But one thing people don't seem to take seriously enough is: If you're doing science and you don't know the literature, then you're doing a bad job. Understanding a paper won't work by reading AI summaries. Finding surprising new papers in your field should be very rare even without tech. [edit] Let me re-phrase the very negative statement above. There are a couple of important task…

Hi, Thanks for the thoughtful response. Disclaimer: I work at scite. I want to clarify one point in your comment because I know a lot of people read HN comments before clicking through: we do NOT offer AI summaries! scite is fundamentally built on the idea that not all citations are equal. We offer disambiguation into citations by extracting the in-text contexts when citations happen between two papers. With that, yo…

@sleepingsoul , how good is your database? Just tried a random paper I've read recently (DOI 10.1109/32.748920). It shows "no citations" in Scite, but Google Scholar shows "Cited by 1180": https://scholar.google.com/scholar?cites=9052935302971671123...

Re: Scite: Smart Citations for Better Research

#7
post #6

Earlier quoted context omitted.

Hi, Thanks for the thoughtful response. Disclaimer: I work at scite. I want to clarify one point in your comment because I know a lot of people read HN comments before clicking through: we do NOT offer AI summaries! scite is fundamentally built on the idea that not all citations are equal. We offer disambiguation into citations by extracting the in-text contexts when citations happen between two papers. With that, yo…

@sleepingsoul , how good is your database? Just tried a random paper I've read recently (DOI 10.1109/32.748920). It shows "no citations" in Scite, but Google Scholar shows "Cited by 1180": https://scholar.google.com/scholar?cites=9052935302971671123...

Hi there,

Well, that's a tricky question to answer! :)

At the moment we use DOIs to link papers / citations, and get our information on DOIs from crossref (https://www.crossref.org/).

So every DOI there is also in our system (and any citation coming from a source without a DOI currently won't be picked up).

From crossref we also have metadata on which publications a given paper references, so we can always show information on how many publications cite a given paper ("traditional citations").

As for our database of Smart Citations (the extracted in-text citation statements) -- the answer is that it depends on our ability to access full-text articles to actually do the citation statement extraction. We're constantly growing in this area through new indexing agreements with publishers and so on.

To your specific question about that DOI, here is the corresponding scite report for that paper: https://scite.ai/reports/a-unified-framework-for-coupling-dZ...

I see that we identified 371 distinct citing publications (and extracted 374 in-text citation statements from those publications).

Can you let me know where you saw it say "no citations"? That sounds like a bug... I'll take a look. You can email me here: ashish@scite.ai

- Ashish

Re: Scite: Smart Citations for Better Research

#8
post #6

Earlier quoted context omitted.

@sleepingsoul , how good is your database? Just tried a random paper I've read recently (DOI 10.1109/32.748920). It shows "no citations" in Scite, but Google Scholar shows "Cited by 1180": https://scholar.google.com/scholar?cites=9052935302971671123...

Hi there, Well, that's a tricky question to answer! :) At the moment we use DOIs to link papers / citations, and get our information on DOIs from crossref ( https://www.crossref.org/ ). So every DOI there is also in our system (and any citation coming from a source without a DOI currently won't be picked up). From crossref we also have metadata on which publications a given paper references, so we can always show inf…

Thanks!

Weird, I searched for that DOI moments before and it showed this result: "This publication either has no citations yet, or we are still processing them"

Let me look into others

Re: Scite: Smart Citations for Better Research

#9
post #6

Earlier quoted context omitted.

@sleepingsoul , how good is your database? Just tried a random paper I've read recently (DOI 10.1109/32.748920). It shows "no citations" in Scite, but Google Scholar shows "Cited by 1180": https://scholar.google.com/scholar?cites=9052935302971671123...

Hi there, Well, that's a tricky question to answer! :) At the moment we use DOIs to link papers / citations, and get our information on DOIs from crossref ( https://www.crossref.org/ ). So every DOI there is also in our system (and any citation coming from a source without a DOI currently won't be picked up). From crossref we also have metadata on which publications a given paper references, so we can always show inf…

I think you have an issue in your UI, or I don't understand how it's supposed to be used

When I have the results from an article in my screen and use the top search to find another, it only updates the upper part of the page with the paper title, not the stats and summary below it

I had searched for an article before that had no citations. That's why I continued to see "no citations" when I searched for the DOI I shared...

Re: Scite: Smart Citations for Better Research

#10
post #6

Earlier quoted context omitted.

Hi, Thanks for the thoughtful response. Disclaimer: I work at scite. I want to clarify one point in your comment because I know a lot of people read HN comments before clicking through: we do NOT offer AI summaries! scite is fundamentally built on the idea that not all citations are equal. We offer disambiguation into citations by extracting the in-text contexts when citations happen between two papers. With that, yo…

@sleepingsoul , how good is your database? Just tried a random paper I've read recently (DOI 10.1109/32.748920). It shows "no citations" in Scite, but Google Scholar shows "Cited by 1180": https://scholar.google.com/scholar?cites=9052935302971671123...

This seems to be very useful. I'm finding a much better experience browsing references made within a paper.
Post reply on HN