Ditching Zotero for a Text File
11–20 of 42 posts
Re: Ditching Zotero for a Text File
#12Also, as my unenlightened colleagues insist on using ridiculous tools like MS Word to author papers in, it's useful to have Zotero installed for the ability to link a BibTeX file to a WYSIWYG word processor when collaborating. Zotero helps you play well with others.
I don't think Zotero is perfect by any stretch, but I'm glad that at least it allowed academia to reject both Endnote and Mendeley. Anything that punches Elsevier in the face gets a tick in my book.
Re: Ditching Zotero for a Text File
#13I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…
Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk.
Sadly, Zotero seems to have removed this killer import feature in later versions, which is the reason I keep using version 6. It feels like later versions have been a route to dumbing-down the interface, prioritising simplicity (and an ultra-low-contrast interface) at the expense of functionality. (If you can still drag-n-drop PDFs straight in with the new versions, someone please let me know?)
Re: Ditching Zotero for a Text File
#14This sells Zotero short in so many ways, but you do you, I guess. Have fun hand formatting between the dozen citation/reference formats every other journal chooses, seemingly at random
Isn't citation format handled entirely in the latex document itself?
Re: Ditching Zotero for a Text File
#15Zotero integrates well with various online services. This I think is Zotero's most valuable feature. The simple fact is that not everything exports BibTeX. Can you get a library catalog to export BibTeX? Perhaps in CS, most publications provide good BibTeX, but a lot of journals I (a mechanical engineer) deal with don't provide BibTeX at all to my knowledge. But I can simply press a button in Firefox and import the bibliographic data embedded in the web page into Zotero. (No, Google Scholar is not a good solution here because it's frequently inaccurate and incomplete.)
I'm a technical guy who can handle BibTeX fine, but I still prefer the Zotero UI over using BibTeX files in a text editor and shell, even if I'm only generating BibTeX files.
The author discusses using non-standard fields like keywords to store extra data. I would recommend that to store additional context about the document. Zotero can store even more than that, including web pages, files, and additional notes. I like that Zotero saves a snapshot of the journal article web page in most instances. Journals sometimes do go offline, so it can be nice to have the web page. I often have detailed notes about particular documents in notes in Zotero. Yes, you can do that with BibTeX, but I could see the extra fields cluttering the BibTeX file. (Contrary to what the author states, the note field probably should not be used as they describe because it's printed in some/most? bibliography styles.)
The search in Zotero is more powerful than grep. Try returning bibliographic entries where one field contains X and another field contains Y. I think you can probably come up with a grep solution for that, but it's so convoluted that it's probably never used in practice. You could use a BibTeX searching program like biblook to get around this problem.
Don't get me wrong. Zotero is far from perfect. It can be slow, and at this point I would prefer a TUI reference manager. But overall, it's the best option I've tried.
Re: Ditching Zotero for a Text File
#16I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…
At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…
Re: Ditching Zotero for a Text File
#17I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…
> First I used Claude Code to generate all the BibTex files for the PDFs I think this has an unnecessary risk of hallucinated bibliographic data. For anyone doing something similar in the future, it would be more reliable to make a LLM generate a list of DOIs and have Zotero import the DOIs.
It's not my cup of vodka, to be sure.
Re: Ditching Zotero for a Text File
#18I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…
At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…
Re: Ditching Zotero for a Text File
#19I just finished importing and sorting thousands of PDF research papers, about 50 GB I've accumulated over the decades. Originally, I was sorting them in file system directly, but the whole thing got out of hand at some point, and thus the Documents folder became a dumping ground for PDFs. So I decided to take control of the situation and use Zotero to manage all this stuff. First I used Claude Code to generate all th…
At least with Zotero Version 6, you could have just selected all your PDFs and drag-n-dropped them into the interface. Like another poster here, trusting an LLM with my reference database -- the ultimate source of truth -- is not a step I'd be willing to take. All it takes is a single hallucinated reference, and your career would be forever tainted. It's not worth the risk. Sadly, Zotero seems to have removed this ki…
Re: Ditching Zotero for a Text File
#20A friend and I have been working (slowly, over the past few years, since we are both academics) on an abstraction layer over BibTeX called Autobib: https://github.com/autobib/autobib
Broadly speaking, Autobib is a CLI around SQLite database of BibTeX records. But in addition to plain BibTeX, Autobib is aware of 'external data providers' (like DOI, MathSciNet, OpenLibrary, arXiv, zbMath, etc.) and will automatically retrieve data bibliographic data from these data providers. The provenance of the data is stored alongside the record itself, and this can be used to retrieve updates, prevent duplication of data, etc.
The killer feature is: if you have a file (say `file.tex`) and the keys are in a format which Autobib can automatically recognize (say, you use citation keys like `doi:my/weird/doi`, and there is support for custom formats and aliases) you can run `autobib source file.tex` and it will write to standard output a sorted BibTeX bibliography for your file. This lets you trivially maintain a per-project bibliography which you can check into source control locally and which exactly corresponds to the paper itself.
But otherwise, Autobib is "just a wrapper over a BibTeX bibliography"! When you edit an existing record, you are just editing a BibTeX record. There is integrated search, directly on the BibTeX fields themselves.
There are some extra features, like support for attachments, fuzzy search, undo-tree support, headless edit, auto-normalization, soft deletion, replacement, merging, etc. The database format is relatively simple and open (currently not particularly well documented, but this will change when it stabilizes) to allow introspection by other tools.
The tool also strives to play nicely with other tools (structured output, composable, etc.)