Making my bookshelves clickable
jamesg.blog
Making my bookshelves clickable
1–10 of 30 posts
Re: Making my bookshelves clickable
#2This is a nice time saving tool for "minimalist" information hoarding.
A pet project of mine is to thin out my bookshelf only to books I regularly reach for and store "never going to read" books out of sight.
The idea is, if I can save the details of the "never going to read books" and acquire a digital copy of them, it may be easier for me to psychologically let go of the physical copy and gain the storage space again.
I was going to take a photo of my crowded bookshelves and manually put the ISBN and titles into a spreadsheet. Keeping the photos simply for extra reference. Your project making the photo clickable is a great bridge between the data and artifact.
Re: Making my bookshelves clickable
#3I would really love a control-f for the real world.
Imagine you have a list of wines you want to try, or used books you’re hoping to buy.
In the store you open your phone and scan the shelves with your camera and if it finds any matches from your lists, it shows you them on the screen.
Re: Making my bookshelves clickable
#4Would it make sense to have the user click and then use that point as a SAM prompt? It might let you find a book even if the initial SAM query doesn't find it.
Re: Making my bookshelves clickable
#5I would really love a control-f for the real world. Imagine you have a list of wines you want to try, or used books you’re hoping to buy. In the store you open your phone and scan the shelves with your camera and if it finds any matches from your lists, it shows you them on the screen.
Same. I've imagined 'spines.com' for books, where the work of linking book spines to ISBN's, etc, has been crowdsourced and you can point your phone camera at a shelf and look up reviews, etc.
Re: Making my bookshelves clickable
#6I would really love a control-f for the real world. Imagine you have a list of wines you want to try, or used books you’re hoping to buy. In the store you open your phone and scan the shelves with your camera and if it finds any matches from your lists, it shows you them on the screen.
Vivino sort of kind of can do that. Has a rapid multi scan mode for shelves. Not quite the pointy AR experience yet though.
Re: Making my bookshelves clickable
#7I would really love a control-f for the real world. Imagine you have a list of wines you want to try, or used books you’re hoping to buy. In the store you open your phone and scan the shelves with your camera and if it finds any matches from your lists, it shows you them on the screen.
Apple lidar is absolutely suited to this, and I’ve always thought there is an opportunity to integrate it into the dollhouse addon in Homeassistant.
Or, create a digital twin of your garden, and simulate light shadows throughout the day after adding or removing a tree. Add pruning schedules to a fruit tree.
It’s trivial to do a scan, but it hasn’t really taken off in a practical sense.
Re: Making my bookshelves clickable
#8What I would really like is a tool that takes a video or series of photos, and automatic catalogues the contents. This would be nice from a ‘document all the things’ perspective, but really, really convenient in case of a fire or theft claim.
If you haven’t already, I strongly urge everyone reading this comment to stand up and do a video walkthrough of your house, today. Do all of your book spines, jewellery, DVDs, games, clothes, tools, cutlery, etc. Take photos of your bike’s serial numbers (usually under the hub).
Store the videos and photos in a cloud album or even a free tier somewhere. Email it to yourself, whatever, just don’t forget to do it.
It might take half an hour or, but this evidence is priceless (in terms of time, but it does actually have an monetary value) if you ever need to claim insurance in case of a fire or buglary.
It simply isn’t possible to remember everything you own.
Some insurers demand photographic evidence of recent ownership - I found this out the hard way (who here has a photo of themselves with their bike?! I even had the receipt!)
Re: Making my bookshelves clickable
#9I would really love a control-f for the real world. Imagine you have a list of wines you want to try, or used books you’re hoping to buy. In the store you open your phone and scan the shelves with your camera and if it finds any matches from your lists, it shows you them on the screen.
Apple lidar is absolutely suited to this, and I’ve always thought there is an opportunity to integrate it into the dollhouse addon in Homeassistant. Or, create a digital twin of your garden, and simulate light shadows throughout the day after adding or removing a tree. Add pruning schedules to a fruit tree. It’s trivial to do a scan, but it hasn’t really taken off in a practical sense.
It took me a while to realize digital twin got autocorrected to digital town here :).
Re: Making my bookshelves clickable
#10Would it make sense to have the user click and then use that point as a SAM prompt? It might let you find a book even if the initial SAM query doesn't find it.
Post author here. I like this idea. I plan to explore it and make a more generic solution. I'd love to have a point-and-click interface for annotating scenes.
For example, I'd like to be able to click on pieces of coffee equipment in a photo of my coffee setup so I can add sticky note annotations when you hover over each item.
For the bookshelves idea specifically, I would love to have a correction system in place. The problem isn't so much SAM as it is Grounding DINO, the model I'm using for object identification. I then pass each identified region to SAM and map the segmentation mask to the box.
Grounding DINO detects a lot of book spines, but often misses 1-2. I am planning to try out YOLO-World (https://github.com/AILab-CVC/YOLO-World), which, in my limited testing, performs better for this task.