awesome, very, works great on sports fields http://sf.terrapattern.com/?_ga=1.257993994.1025291016.14642...
Terrapattern: a visual search tool for satellite imagery
11–20 of 22 posts
Re: Terrapattern: a visual search tool for satellite imagery
#12I helped out with this project, happy to answer any questions. I was involved from the beginning, but my biggest contribution was on the deep learning side that does the tile-matching. I helped with the initial prototype using DIGITS, Caffe, and a bunch of Python. Then Aman Tiwari moved us to a more accurate 34-layer ResNet trained in TensorFlow, and a more efficient nearest neighbor lookup using a new implementation…
Very impressive :-) How easy would it be to roll it out on all other places on Earth than the current 4 cities?
On the front end, it's easy——Add a couple lines to a configuration file, make a couple images, and it's done.
The difficult part is that the search is not optimized to be RAM-efficient; each city takes between two and ten gigabytes of RAM. You also need to have several hundred thousand tile images, which are commercially available, but not free.
If you've got a hefty server and the images, then it takes about a computer-day to compute the features and create the search index.
Re: Terrapattern: a visual search tool for satellite imagery
#13Earlier quoted context omitted.
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation fo…
Not Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a pl…
In my experience in the USA, OpenStreetMap data that comes from TIGER (?) imports, like heliports, are close but wrong. Playgrounds and watertowers are usually accurate because someone added them by hand. Churches are mixed. Other items are confusing; a hospital is typically a single point, but they tend to be some of the largest buildings in small towns.
Any thoughts on how that affects your model?
Re: Terrapattern: a visual search tool for satellite imagery
#14Earlier quoted context omitted.
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation fo…
Not Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a pl…
Any plans to take imagery with suitable licensing and produce a list of items that seem to be missing in OSM?
(Google prohibits feature extraction in their TOS and claims copyright, so OSM can't use information derived from their imagery)
Re: Terrapattern: a visual search tool for satellite imagery
#15Earlier quoted context omitted.
Not Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a pl…
In my experience in the USA, OpenStreetMap data that comes from TIGER (?) imports, like heliports, are close but wrong. Playgrounds and watertowers are usually accurate because someone added them by hand. Churches are mixed. Other items are confusing; a hospital is typically a single point, but they tend to be some of the largest buildings in small towns. Any thoughts on how that affects your model?
Most of the messy point features in the US were imported from GNIS. TIGER is the primary source for the messy line features.
Sticking to features modeled as areas would generally avoid the spatial accuracy problems with GNIS.
Re: Terrapattern: a visual search tool for satellite imagery
#16I see that the satellite pictures come from openstreetmap, but I'm not familiar how often those pictures are updated, anybody know? When they are updated, does Terrapattern recognize the change an update the corresponding photos?
Bing reports imagery age in a header. This tool visualizes it:
http://mvexel.dev.openstreetmap.org/bing/
As reported in a sibling comment, they are using Google imagery.
Re: Terrapattern: a visual search tool for satellite imagery
#17Earlier quoted context omitted.
Not Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a pl…
In my experience in the USA, OpenStreetMap data that comes from TIGER (?) imports, like heliports, are close but wrong. Playgrounds and watertowers are usually accurate because someone added them by hand. Churches are mixed. Other items are confusing; a hospital is typically a single point, but they tend to be some of the largest buildings in small towns. Any thoughts on how that affects your model?
We found the same—using OSM data that just had points was problematic, both because of accuracy and because it tended to often be the front door, not the centroid of the object.
I believe we limited our model generation to selecting places that had outlines, and computed the centroid of that outline. One of the benefits of our technique is that we didn't need to be comprehensive—we can throw out lots of places and still have enough to be useful for the model.
Re: Terrapattern: a visual search tool for satellite imagery
#18I helped out with this project, happy to answer any questions. I was involved from the beginning, but my biggest contribution was on the deep learning side that does the tile-matching. I helped with the initial prototype using DIGITS, Caffe, and a bunch of Python. Then Aman Tiwari moved us to a more accurate 34-layer ResNet trained in TensorFlow, and a more efficient nearest neighbor lookup using a new implementation…
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation fo…
everything david (workergnome) said, and also: in the tile you point to, "swimming pool" is most interesting/recognizable feature, but most of the image is just "trees and asphalt". if you pick another image where the pool takes up more of the image, you'll find more of what you're looking for: http://nyc.terrapattern.com/?_ga=1.84865689.1830936426.14642...
Re: Terrapattern: a visual search tool for satellite imagery
#19I helped out with this project, happy to answer any questions. I was involved from the beginning, but my biggest contribution was on the deep learning side that does the tile-matching. I helped with the initial prototype using DIGITS, Caffe, and a bunch of Python. Then Aman Tiwari moved us to a more accurate 34-layer ResNet trained in TensorFlow, and a more efficient nearest neighbor lookup using a new implementation…
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation fo…
Interestingly, it worked amazingly well detecting small round swimming pools in Pittsburgh: http://pgh.terrapattern.com/?lat=40.3944695&lng=-79.98947650...
This would have been very handy when the Greek government was scanning for undeclared swimming pools!
Re: Terrapattern: a visual search tool for satellite imagery
#20Earlier quoted context omitted.
Since you've opened up yourself to questioning :)...Thanks for sharing, I apologize for this very laymanny question: I clicked on a swimming pool in New York City...there aren't a ton of them in NYC, but very few of the matches have even a spot of blue in them...I know the algorithm is more than just "look for more blue patches"...if I were to explain this to another layperson, what is the most obvious explanation fo…
Not Kyle, but another of the team involved in the project. When we built the training model, we used OpenStreetmap data to find locations of ~1,000,000 "things". A thousand churches, a thousand water towers, a thousand playgrounds, and so on. For each of those locations, we downloaded a satellite image. The neural net was then trained to look for the things that make each one of those things distinct; what makes a pl…
Thanks for the explanation...yeah, as I said, you're talking to a layperson :). I just realized that it was possible that the training was done on images where the color scale was changed, so thinking about it in terms of "well blue patches are so easy to see" is obviously wrong.