Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open-source text-to-geolocation models

github.com

Post reply on HN
Print view View original

11–20 of 21 posts

Re: Show HN: Open-source text-to-geolocation models

#11

Post by rmbyrro »

JimDabell wrote: post #9
rmbyrro wrote: post #5

Earlier quoted context omitted.

Tried this in the past, it's too limited... There are too many ways certain locations can be referred to. Take: New York City, NYC, NY, New York, NYCity, so on...

Wikipedia handles “New York City” and “NYC” as intended. “NY” and “New York” are ambiguous to both machines and humans (are you referring to the city or the state?) and if you have a resolution strategy for this then Wikipedia gives you the options to disambiguate. I’ve never seen “NYCity” used by anybody.

If you start processing web articles on the scale of millions you'll be surprised by how creative people can be. Not talking about tweets, just news and blog articles.

Re: Show HN: Open-source text-to-geolocation models

#13

Post by JimDabell »

rmbyrro wrote: post #11
JimDabell wrote: post #9

Earlier quoted context omitted.

Wikipedia handles “New York City” and “NYC” as intended. “NY” and “New York” are ambiguous to both machines and humans (are you referring to the city or the state?) and if you have a resolution strategy for this then Wikipedia gives you the options to disambiguate. I’ve never seen “NYCity” used by anybody.

If you start processing web articles on the scale of millions you'll be surprised by how creative people can be. Not talking about tweets, just news and blog articles.

Not surprised, just not relevant. The criteria here is “you can get pretty good results”, not “you must be able to process millions of articles without failure”.

Re: Show HN: Open-source text-to-geolocation models

#14

Post by rmbyrro »

JimDabell wrote: post #13
rmbyrro wrote: post #11

Earlier quoted context omitted.

If you start processing web articles on the scale of millions you'll be surprised by how creative people can be. Not talking about tweets, just news and blog articles.

Not surprised, just not relevant. The criteria here is “you can get pretty good results”, not “you must be able to process millions of articles without failure”.

If a method is not generalizable to the entire dataset, it's not that useful.

When processing text at large scale, the usefulness of heuristic approaches like the one we're discussing diminishes rapidly.

Re: Show HN: Open-source text-to-geolocation models

#15

Post by JimDabell »

rmbyrro wrote: post #14
JimDabell wrote: post #13

Earlier quoted context omitted.

Not surprised, just not relevant. The criteria here is “you can get pretty good results”, not “you must be able to process millions of articles without failure”.

If a method is not generalizable to the entire dataset, it's not that useful. When processing text at large scale, the usefulness of heuristic approaches like the one we're discussing diminishes rapidly.

> If a method is not generalizable to the entire dataset, it's not that useful.

No, in many situations, something doesn’t have to be perfect to be useful.

Again, I think you are missing the original point being made:

> Depending upon your use-case, you can get pretty good results by…

You seem to be responding as if I said:

> For all use-cases, you can get flawless results by…

Pointing out that this is not perfect is irrelevant to the point I was making. “Good enough” is usually good enough.

Re: Show HN: Open-source text-to-geolocation models

#16

Post by yachayai »

rmbyrro wrote: post #7
tomthe wrote: post #6

There are no weights and no data, only some code to create a pytorch character based network and train it. Will you provide weights or data in the future? Do you have any benchmark over Nominatim or Google maps? I think something like this (but with more substance) could be helpful for some people, especially in the social sciences.

Yea, I was expecting a general-purpose model or dataset to train a model. The idea is great, but - as it currently stands - of no use to most people.

We have posted a challenge with the respective data set of ~ 500k tweets from 100 regions around the world - https://github.com/1712n/yachay-public/tree/master/conf_geot...

Re: Show HN: Open-source text-to-geolocation models

#17

Post by yachayai »

neoncontrails wrote: post #10

This is _really_ cool. Early in the pandemic I released a local news aggregation tool that aimed to aggregate COVID-related content and score it for relevance using an ensemble of ML classification models, including one that would attempt to infer an article's geographic coordinates. Accuracy peaked at about ~70-80%, which was just not quite high enough for this use case. With a large enough dataset of geotagged docu…

Thanks! COVID is a great example of the use case, and we agree problems like this need more attention - we've shared some data already, and will continue to share more with the public to encourage collaboration on this. Hope you will find something useful there for your future projects:)

Re: Show HN: Open-source text-to-geolocation models

#18

Post by yachayai »

DOsinga wrote: post #8

This does look interesting but as other comments have pointed out without data or weights it's not clear how well this works. The training notebook seems to suggest it is not actually improving all that much on the training data

As mentioned in the response below, we have posted the challenge with a respective data set of ~ 500k tweets from 100 regions around the world - https://github.com/1712n/yachay-public/tree/master/conf_geot...

We are working on adding more data as well - feel free to create a GitHub issue if there's more you need - we're going to be working on everything there is to do to help the developers here:)

Re: Show HN: Open-source text-to-geolocation models

#19

Post by yachayai »

JimDabell wrote: post #4

Depending upon your use-case, you can get pretty good results by using spaCy for named entity recognition then matching on the titles of Wikipedia articles that have coördinates.

Agreed. That said, more often than not, as mentioned in the comment above (COVID use case), we'd look for a higher recall value in the predictions - there, NERs, although helpful, wouldn't be our go-to solution. This is exactly the reason why we open sourced the infrastructure and are rolling out the data

Re: Show HN: Open-source text-to-geolocation models

#20

Post by yachayai »

TuringNYC wrote: post #2

Has anyone got this working? Curious if someone could PR a dependencies file that can be used to run this?

We have updated the wiki and published the dependencies:) Feel free to create a GitHub issue for any further requests, or ask away in our discord - https://discord.gg/msWFtcfmwe
Post reply on HN