Stop, you're making the barrier to entry too low! /s This is really really cool. Between this and Hugginfaces Dataset and models hubs, AI/ML is really getting easier to use.
I've actually been on the lookout for model hubs lately. Any that you've seen or reccomend? I've found https://modelzoo.co/ but it seems more like a currated list of models (some incomplete) rather than a community where users share trained models.
Google Dataset Search
21–30 of 44 posts
Re: Google Dataset Search
#22Earlier quoted context omitted.
It’s ok, but surprisingly feature poor since they only index datasets with structured metadata. I kind of wish they would compile all their metadata into a structured mega-catalog and allowed searching by api. Or just dumped it out as a dataset itself.
Then you'll love what we're doing at Splitgraph: https://www.splitgraph.com/connect As far as your SQL client is concerned, data.splitgraph.com:5432 is a giant Postgres database with ~40,000 tables in it. You can query and join across them using your existing tools. Behind the curtain, we'll forward your query to the upstream data source, translating it from SQL to whatever language it expects. (We can also ingest de…
Do you translate to api calls and query in real-time? Or are you ingesting and archiving?
Re: Google Dataset Search
#23Earlier quoted context omitted.
This is not new, though. So it may be a dream in the sense of people have been asleep?
Why the condescension? Do you mean that Google has been offering this service for a while? Or do you mean that similar services have previously been offered by other organizations? In which case, perhaps you could link to them?
Re: Google Dataset Search
#24https://www.arcgis.com/home/item.html?id=9850793c688e4eebaab...
Can anybody explain why this showed up in a dataset search and what exactly the data is?
Re: Google Dataset Search
#25Earlier quoted context omitted.
Then you'll love what we're doing at Splitgraph: https://www.splitgraph.com/connect As far as your SQL client is concerned, data.splitgraph.com:5432 is a giant Postgres database with ~40,000 tables in it. You can query and join across them using your existing tools. Behind the curtain, we'll forward your query to the upstream data source, translating it from SQL to whatever language it expects. (We can also ingest de…
That’s pretty cool, I’ll test it out when I get to a machine with a Postgres client. Do you translate to api calls and query in real-time? Or are you ingesting and archiving?
Our core philosophy has always been that it makes sense to start with data federation (live data), and then selectively warehouse/ingest only what you need (versioned data). We're shipping some upcoming features to support this workflow. You start by providing us (or your private deployment) a set of read-only credentials to any supported data source, which we then "mount" as a repository, making it discoverable in the catalog, and instantly queryable with all the other data on Splitgraph. If or when you decide that you want to warehouse this data, we'll make it easy for you to schedule a loading job to ingest it as a Splitgraph image. This way, you can query the live or versioned data in any repository, by simply changing the tag you use to address it.
You can do all this stuff locally, btw – a decentralized workflow is fully supported, and you can push data between peers. The public Splitgraph.com happens to be a "super peer" with a data catalog, scalability features, etc. But if you just want to experiment on your own, you can try it in five minutes!
I don't want to spam this thread too much, so I'll limit it to one link – maybe take a look at the Splitfile docs: https://www.splitgraph.com/docs/working-with-data/using-spli...
Re: Google Dataset Search
#26I was looking up dentistry data sets (my industry) and came across this: https://www.arcgis.com/home/item.html?id=9850793c688e4eebaab... Can anybody explain why this showed up in a dataset search and what exactly the data is?
Re: Google Dataset Search
#27I was looking up dentistry data sets (my industry) and came across this: https://www.arcgis.com/home/item.html?id=9850793c688e4eebaab... Can anybody explain why this showed up in a dataset search and what exactly the data is?
Someone trying to do SEO by getting links to their site from a popular one?
Re: Google Dataset Search
#28Earlier quoted context omitted.
It’s ok, but surprisingly feature poor since they only index datasets with structured metadata. I kind of wish they would compile all their metadata into a structured mega-catalog and allowed searching by api. Or just dumped it out as a dataset itself.
Then you'll love what we're doing at Splitgraph: https://www.splitgraph.com/connect As far as your SQL client is concerned, data.splitgraph.com:5432 is a giant Postgres database with ~40,000 tables in it. You can query and join across them using your existing tools. Behind the curtain, we'll forward your query to the upstream data source, translating it from SQL to whatever language it expects. (We can also ingest de…
We have the need for large public datasets for testing ClickHouse: https://clickhouse.tech/docs/en/getting-started/example-data...
Re: Google Dataset Search
#29[0] - https://datasetsearch.research.google.com/search?query=penis... [1] - https://data.world/jemus42/world-penis-data