Live data from Hacker News

Ditching Zotero for a Text File

atthis.link

11–20 of 42 posts

Re: Ditching Zotero for a Text File

#12
Unlike grepping your BibTeX file, Zotero provides a nice tabbed PDF viewer, useful automatic import options with file renaming, and saved dynamic searches. Those are the main reasons why I still use it -- it's a good tool to manage my BibTeX file via a nice GUI, and faster than manually grepping BibTeX from the CLI.

Also, as my unenlightened colleagues insist on using ridiculous tools like MS Word to author papers in, it's useful to have Zotero installed for the ability to link a BibTeX file to a WYSIWYG word processor when collaborating. Zotero helps you play well with others.

I don't think Zotero is perfect by any stretch, but I'm glad that at least it allowed academia to reject both Endnote and Mendeley. Anything that punches Elsevier in the face gets a tick in my book.

Re: Ditching Zotero for a Text File

#13
post #6

I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…

At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface.

Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk.

Sadly, Zotero seems to have removed this killer import feature in later versions, which is the reason I keep using version 6. It feels like later versions have been a route to dumbing-down the interface, prioritising simplicity (and an ultra-low-contrast interface) at the expense of functionality. (If you can still drag-n-drop PDFs straight in with the new versions, someone please let me know?)

Re: Ditching Zotero for a Text File

#14

This sells Zotero short in so many ways, but you do you, I guess. Have fun hand formatting between the dozen citation/reference formats every other journal chooses, seemingly at random

Isn't citation format handled entirely in the latex document itself?

Mostly yes, you still need to check capitalisation of special words... But this should be independent of the actual citation style.

Re: Ditching Zotero for a Text File

#15
Zotero is not just a front-end to BibTeX. Here are some things I like about Zotero off the top of my head:

Zotero integrates well with various online services. This I think is Zotero's most valuable feature. The simple fact is that not everything exports BibTeX. Can you get a library catalog to export BibTeX? Perhaps in CS, most publications provide good BibTeX, but a lot of journals I (a mechanical engineer) deal with don't provide BibTeX at all to my knowledge. But I can simply press a button in Firefox and import the bibliographic data embedded in the web page into Zotero. (No, Google Scholar is not a good solution here because it's frequently inaccurate and incomplete.)

I'm a technical guy who can handle BibTeX fine, but I still prefer the Zotero UI over using BibTeX files in a text editor and shell, even if I'm only generating BibTeX files.

The author discusses using non-standard fields like keywords to store extra data. I would recommend that to store additional context about the document. Zotero can store even more than that, including web pages, files, and additional notes. I like that Zotero saves a snapshot of the journal article web page in most instances. Journals sometimes do go offline, so it can be nice to have the web page. I often have detailed notes about particular documents in notes in Zotero. Yes, you can do that with BibTeX, but I could see the extra fields cluttering the BibTeX file. (Contrary to what the author states, the note field probably should not be used as they describe because it's printed in some/most? bibliography styles.)

The search in Zotero is more powerful than grep. Try returning bibliographic entries where one field contains X and another field contains Y. I think you can probably come up with a grep solution for that, but it's so convoluted that it's probably never used in practice. You could use a BibTeX searching program like biblook to get around this problem.

Don't get me wrong. Zotero is far from perfect. It can be slow, and at this point I would prefer a TUI reference manager. But overall, it's the best option I've tried.

Re: Ditching Zotero for a Text File

#16
post #6

I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…

At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…

I still drag and drop PDFs in Zotero 7. It's less finicky then v6, even. The trick is to drop them to root of the tree on the left. Not to the middle of the interface.

Re: Ditching Zotero for a Text File

#17
post #9
post #6

I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…

> First I used Claude Code to generate all the BibTex files for the PDFs I think this has an unnecessary risk of hallucinated bibliographic data. For anyone doing something similar in the future, it would be more reliable to make a LLM generate a list of DOIs and have Zotero import the DOIs.

Using a non-deterministic machine on something which needs to be pretty accurate and precise looks like playing Russian roulette with one's academic integrity.

It's not my cup of vodka, to be sure.

Re: Ditching Zotero for a Text File

#18
post #6

I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…

At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…

I drag-drop PDFs and ePubs, read PDFs and ePubs, and sync mobile with laptop, etc.

Re: Ditching Zotero for a Text File

#19
post #6

I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…

At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…

Drag-and-drop of the PDF file worked for me in Zotero 9 (latest version). I never used this feature before. This would be greatly preferred to my earlier suggestion to get a LLM to generate a list of DOIs.

Re: Ditching Zotero for a Text File

#20
I think Zotero is an excellent tool and I used it for a long time. However, like the author, I also felt that Zotero was not the ideal tool for me. But a straight BibTeX file is also rather unwieldy. Essentially, bibliographic data has provenance (say, a DOI identifier), and it is very useful to keep track of this in a structured way.

A friend and I have been working (slowly, over the past few years, since we are both academics) on an abstraction layer over BibTeX called Autobib: https://github.com/autobib/autobib

Broadly speaking, Autobib is a CLI around SQLite database of BibTeX records. But in addition to plain BibTeX, Autobib is aware of 'external data providers' (like DOI, MathSciNet, OpenLibrary, arXiv, zbMath, etc.) and will automatically retrieve data bibliographic data from these data providers. The provenance of the data is stored alongside the record itself, and this can be used to retrieve updates, prevent duplication of data, etc.

The killer feature is: if you have a file (say `file.tex`) and the keys are in a format which Autobib can automatically recognize (say, you use citation keys like `doi:my/weird/doi`, and there is support for custom formats and aliases) you can run `autobib source file.tex` and it will write to standard output a sorted BibTeX bibliography for your file. This lets you trivially maintain a per-project bibliography which you can check into source control locally and which exactly corresponds to the paper itself.

But otherwise, Autobib is "just a wrapper over a BibTeX bibliography"! When you edit an existing record, you are just editing a BibTeX record. There is integrated search, directly on the BibTeX fields themselves.

There are some extra features, like support for attachments, fuzzy search, undo-tree support, headless edit, auto-normalization, soft deletion, replacement, merging, etc. The database format is relatively simple and open (currently not particularly well documented, but this will change when it stabilizes) to allow introspection by other tools.

The tool also strives to play nicely with other tools (structured output, composable, etc.)

Post reply on HN