Live data from Hacker News

Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

nianticlabs.com

241–250 of 365 posts

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#241
post #193

We do this at [name redacted as this was a joke]. When users scan their barcode, the preview window is zoomed in so users think its mostly barcode. We actually get quite a bit more background noise typically of a fridge, supermarket aisle, pantry etc. but it is sent across to us, stored, and trained on. Within the next year we will have a pretty good idea of the average pantry, fridge, supermarket aisle. Who knows wh…

If this is real, I hope MyFitnessPal doesn't operate in the EU.

Or rather, I hope they do, and receive an appropriate fine for this, if not even criminal prosecution (e.g. if the app uploaded nonconsensual pornography of someone visible only in the cropped out space).

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#242
post #11

I can really imagine a meeting with the big brasses of Google/Niantic a few years ago that went along - We need to be the first to have a better, new generation 3D model of the world to build the future of maps on it. How can we get that data?" + What about gamifying it and crowd-sourcing it to the masses? - Sure! Let's buy some Pokemon rights! It's scary but some people do really have some long-term vision

Pokemon Go is built on the same engine as Inverness I think its called. When it launched they even used the same POIs. I think this was ~5-7 years before PGO launched. Edit: I said inverness and meant ingress. Apologies.

Pokemon Go was launched on the Unity game engine in 2016. Ingress was using a different game engine at the time, and wasn't rewritten into Unity until several years later. Even the backend/server side was significantly different, with them needing to write a shim to ensure compatibility during & after the move to Unity.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#243

Earlier quoted context omitted.

> Unsarcastically, a lot of people believe user data belongs to users, and that they should have a say in how it's used I can understand that people believe this, but why do they do? Nothing in our society operates in a way that might imply this.

> Nothing in our society operates in a way that might imply this. I beg your pardon? Consider just about any physical belonging — say, a book. When I buy a book, it belongs to me. When I read a book in my home, I expect it to be a private experience (nobody data-mining my eyeball movements, for example). This applies to all sorts of things. Even electronic things — if I put some files on a USB stick I expect them to…

> This applies to all sorts of things. Even electronic things — if I put some files on a USB stick I expect them to be "mine" and used as I please, not uploaded to the cloud behind my back, or similar.

Every app you open on Mac sends a "ping" to Apples servers.

https://acecilia.medium.com/apple-is-sending-a-request-to-th....

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#244

Earlier quoted context omitted.

Because not everyone is a seasoned IT professional.

I don't think you need to be an "IT professional" to understand that not paying money doesn't imply that you aren't giving away value.

The normal business model for free to play games is that a small number of people pay a lot of money for cosmetics or convenience, this finances the game and is how the company makes its money. The free players then provide value by being there making the game feel alive and being someone, the spenders can show off their cool items to.

That is how monetization for free to play games have worked for a very long time now. Changing that without letting people know up front is absolutely a betrayal of trust.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#245
post #117

Earlier quoted context omitted.

Niantic made 700 million dollars last year, mostly selling virtual game items.

Why would anyone think niantic would protect user-data from profit?

I'm not a fan of the way you moved the goal posts here. You argued that Niantic would obviously use user data to fund game operations. Then we see that they don't actually need to do that, and that the game could fund itself. Then you argue that well, we shouldn't assume that they wouldn't try to monetize user data, shame on us. I agree that those who know how tech companies operate should be extremely pessimistic as to how users are treated, but I don't think that pessimism has permeated the public consciousness to quite the level you think it has. Moreover, I don't think it's a failing on the part of the user to assume that a company would do something in their best interest. It's a failing of the company to treat users as commodities whose only value is to be sold.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#246
Very cool.

However, I can't fully agree that generating 3d scene "on the fly" is the future of maps and many other use cases for AR.

The thing with geospatial, buildings, roads, signs, etc. objects is that they are very static, not many changes are being made to them and many changes are not relevant to the majority of use cases. For example: today your house is white and in 3 years it has stains and yellowish color due to time, but everything else is the same.

Given that storage is cheap and getting cheaper, bandwidth of 5G and local networks is getting too fast for most current use cases, while computer graphics compute is still bound by our GPU performance, I say that it would be much more useful to identify the location and the building that you are looking at and pull the accurate model from the cloud (further optimisations might be needed like to pull only the data user has access to or needs access to given the task he is doing). Most importantly users will need to have access to a small subset of 3D space on daily basis, so you can have a local cache on end devices for best performance and rendering. Or stream rendered result from the cloud like nVidia GDN is doing.

Most precise models will come from CAD files for newly built buildings, retrospectively going back to CAD files of buildings build in last 20-30 years(I would bet most of them have some soft of computer model made before) and finally going back even further - making AI look at the old 2D construction plans of the building and reconstructing it in 3D.

Once the building is reconstructed (or a concrete pole like shown in the article) you can pull its 3D model from the cloud and place it in front of the user - this will cover 95% of use cases for AR. For 5% of the tasks you might want real time recognition of the current state of surfaces for some tasks or changes in geometry (like tracking the changes in the road quality compared with the previous scans or with reference model), but these cases can be tackled separately and having precise 3D model will only help, but won't be needed to be reconstructed from scratch.

This is a good 1st step to make a 3D map, however there should be an option to go to the real location and make edits to 3D plan by the expert so that the model can be precise and not "kind of" precise.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#247
post #193

We do this at [name redacted as this was a joke]. When users scan their barcode, the preview window is zoomed in so users think its mostly barcode. We actually get quite a bit more background noise typically of a fridge, supermarket aisle, pantry etc. but it is sent across to us, stored, and trained on. Within the next year we will have a pretty good idea of the average pantry, fridge, supermarket aisle. Who knows wh…

I really hope this is a joke, as someone who diligently uses the barcode feature on MFP everyday.......

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#248

Earlier quoted context omitted.

> which is totally unfair, every niantic player should have access to all the stuff because they collectively made it I don't understand this perspective. While all players may have collectively made this model possible, no individual player could make a model like it based on their contributions alone. Since no single player could replicate this outcome based on only their data, does it not imply that there's value…

Most of your analysis is flawed because the model is non-rivalrous so it could easily be given to every player. Additionally, many people can contribute to make something greater that benefits everyone (see open source). So the argument of “you couldn’t have done this on your own” also doesn’t hold any water. The only thing that protects niantic is just a shitty ToS like the rest of the games that nobody pays attenti…

> Most of your analysis is flawed because the model is non-rivalrous so it could easily be given to every player.

Sure, copying it is approximately free. But using it provides value, and sharing the model dilutes the value of its usage. The fact that it's free to copy doesn't mean it's free to share. The value of the copy that Niantic uses will be diluted by every copy they make and share with someone else.

> Additionally, many people can contribute to make something greater that benefits everyone (see open source). So the argument of “you couldn’t have done this on your own” also doesn’t hold any water.

Your second sentence does not logically follow from the first. In fact, your first sentence is an excellent example of the point I was making: many people contribute to open-source projects, and the value of the vast majority of those contributions on their own do not amount to the sum total value of the projects they've contributed to. This is what I meant by "your own individual input is itself insufficient to have created it in the first place". Sure, many people contribute to open source projects to make them what they are, but in the vast majority of cases, any individual contributor on their own would be unable to create those same projects.

To rephrase your first sentence: the value of the whole is greater than the value of the parts. There is value in putting all the pieces together in the right way, and that value should rightfully be allocated to those who did the synthesis, not to those who contributed the parts.

Is a canvas-maker entitled to every painting produced on one of their canvasses? Without the canvas the painting would not exist--but merely producing the canvas does not make it into a painting. The value is added by the artist, not the canvas-maker--therefore the value for the produced art should mostly go to the artist, not the canvas-maker. The canvas maker is compensated for the value of the canvas itself (which isn't much), and is entitled to nothing beyond.

> The only thing that protects niantic is just a shitty ToS like the rest of the games that nobody pays attention to. There is nothing fundamentally “right” about what they did.

There's also nothing fundamentally wrong about it, either, which was my point. Well, my point was actually that it's even more shitty to demand the sum total of the output when you only contributed a tiny slice of the input.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#249
post #143

I still don't get what LGM is. From what I understood, it isn't actually about any "geospatial" data at all, is it? It is rather about improving some vision models to predict how the backside of a building looks, right? And training data isn't of people walking, but from images they've produced while catching pokemons or something? P.S.: Also, if that's indeed what they mean, I wonder why having google street view da…

> And training data isn't of people walking, but from images they've produced while catching pokemons or something?

Training data is people taking dedicated video of locations. Only ARCore supported devices can submit data as well. So I assume along with the video they're also collecting a good chunk of other data such as depth maps, accelerometer, gyrometer, magnetometer data, GPS, and more.

Re: Niantic plans a “Large Geospatial Model” trained on Pokémon Go player data

#250
post #201
post #12

Earlier quoted context omitted.

Google maps has more data than PGO could ever hope to have.

But you only use Maps when you need directions.

I don’t think this is sarcasm.

Until pretty recently, phone telemetry data was a free-for-all, and if you’re, say, in legal trouble, a map of the location of your phone over the past… however long you’ve had your phone is immediately available.

Post reply on HN