Live data from Hacker News

Ask HN: How can I automatically scan and catalog a mountain of books?

news.ycombinator.com

11–20 of 142 posts

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#11
Zotero (the free software reference manager) hooks into a bunch of online catalogues. You can use Zotero to manage books (I manage my own collection with it, but that's just a small personal home library of around 1000 books).

If a book has an ISBN, often Zotero will manage to find it using the magic lookup button. Just enter the ISBN (DOI's work too!) and it will usually find the book you meant. That covers about 90% of books with an ISBN.

The rest would have to be entered manually.

Zotero is not a full-blown inventory manager, but it may suit your needs.

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#12
First, is this really a problem that needs to be solved? Personally, his place sounds like my favorite kind of book shop. A lot of bookworms prefer wandering through dense forests of precariously-balanced piles of books. Is he getting those people, or is he getting people that are expecting Barnes & Noble?

If they really do need to be cataloged, then the next thing is to forget all about trying to inventory the entire thing. Instead, you're going to partition the collection into "easy to catalog" and "hard to catalog": pick a section of the barn and make this the organized area. Get a barcode scanner (https://www.newegg.com/Barcode-Scanner/SubCategory/ID-583) and throw together a quick API client that'll take an ISBN and display a title, author, edition, and picture. If it comes up correct, great: book goes into the cataloged section. If it doesn't, it goes somewhere else. Make it really simple, so that a single keystroke can accept that book into inventory.

Grocery stores have to regularly inventory everything on the shelves. I worked for an outfit once that wanted to do it all in-house, so we bought the commercial Telxon handheld wireless devices and I set about figuring out their software. Turned out that they just wanted to speak basic telnet to a server at a pre-configured IP address, so I put together a sloppy little telnet server interface and staff were able to count the entire store right on the devices in a few hours. That's way more complicated than what you'll need to do, so, y'know, your thing is doable. You'll have the added benefit of free online book databases and better hardware and easier-to-hack-together software.

Also might not be a bad idea to talk to your local librarian. They're book nerds too and he or she might have an actual library science degree. This would be right up their alley.

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#13
post #4

Ask a professional. And by that I mean - get in touch with Jason Scott: https://twitter.com/textfiles

If we say books and professional, I think of the Internet Archive. They developed their own software which is used on the TT Scribe system, see https://archive.org/details/tabletopscribesystem. These people run an amazing operation, but even for them this still involves a lot of manual labor. In the end, what it takes is a person to grab a book and type in the title.

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#14
post #6
post #2

If they are recent books (from about 1980) then they probably have a barcode on the back cover, so use that. My guess is that it won't be worth trying to automatically recognise older books from the cover: a lot of them had a dust jacket, that goes missing, and a cover under the dust jacket that is not at all distinctive. The title might be on the spine, but how many online images show the spine clearly?

I tried doing a book catalog about ten years ago. I got about 80% recognition rate by using multiple numbers (ISBN, and the Library of Congress number) and multiple online data sources. It was a pretty slow process, to the point where simply keyboarding the information was easier and less error-prone, and I had to manually enter the books that didn't get any online matches anyway. Definitely not a "scan/beep/scan/bee…

The last time I looked at this (admittedly quite a while ago) the book bar code contained the ISBN.

What was causing the mismatches? Bar codes that did not contain the ISBN? Non-unique numbers?

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#15
One of these days I need to write my essay titled "Rubbish has no SKU".

I've seen a few of these, and the basic minimum difference between "pulp waiting to happen" and "bookshop" is basic shelving. Different shelves by category: fiction vs non-fiction and their subdivisions. Within the shelves, alphabetise. Now it's possible for browsers to actually find things. When you put them on Amazon this will also help find them for shipping.

This process will also help you find the stacks of duplicates. You'll have a crate of 50 Shades and Twilight and Stephen King. The Stephen King will eventually resell; the others won't.

This page from the excellent Barter Books on their acceptance policy may be of some help: https://www.barterbooks.co.uk/html/About%20Us/Incoming%20Boo...

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#17
post #8

Goodreads has a scanner in their app (on iOS/Android) that can scan covers although for some reason it automagically adds those books into a "to-read" shelf but I guess this isn't a problem for you if you create an account for the purpose. The API is severely rate-limited (1rps), non-standard oath and badly documented, but you should be able to get some xml out of it and parse that however you'd like.

Also, you can download the book information in a CSV format.

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#19
Use one of the solutions listed below, but you HAVE to do sorting on the fly. You need to have places to put books and sort them by some general genres and you HAVE to throw out books that aren't worth the time due to damage or any other reason a book would be deemed a recyclable. With that many books, a proper library style cataloging system may be your best bet.

That being said, if you do want to do image comparison for covers, books without covers usually have a copyright page with most of the info on it. Use that to determine what a book is when the other method fails. Throwing together some cheap bookshelves with plywood and 2x4's will greatly help with the finding part, but while scanning use some big bins to do a rough sort.

And I can't stress enough you HAVE to throw out books. It's clear that there's a space issue and if he's willing to get them for free but has a hard time getting rid of them, that's hoarder behavior, not just eccentricity.

Re: Ask HN: How can I automatically scan and catalog a mountain of books?

#20
post #15

One of these days I need to write my essay titled "Rubbish has no SKU". I've seen a few of these, and the basic minimum difference between "pulp waiting to happen" and "bookshop" is basic shelving. Different shelves by category: fiction vs non-fiction and their subdivisions. Within the shelves, alphabetise. Now it's possible for browsers to actually find things. When you put them on Amazon this will also help find th…

At a local LP shop, they had a sign saying "If you misshelve a LP, you might as well steal it, at least someone will listen to it" (approximate translation).

Shelving in instead central to many specialty shops!

Post reply on HN