Live data from Hacker News

Wikidata

wikidata.org

21–30 of 69 posts

Re: Wikidata

#21
post #4

Related, see this older attempt to create a structured dataset from Wikipedia rooting back to the semantic web: https://en.wikipedia.org/wiki/DBpedia "DBpedia (from "DB" for "database") is a project aiming to extract structured content from the information created in the Wikipedia project."

Ya but I haven’t seen a new release of DBpedia in years.

DBPedia board has been faffing about regarding the new hyper-relational data model [0] and has come up with a bunch of hack-ish solutions (read: esoteric data models) to incorporate it. As far as I remember, there were dumps from 2018 with some hyper-relational facts but by and large the go-to dumps is from 2016-10 [1].

I think they acknowledge that info-box information is no longer good enough (both in coverage and completeness) and have handed over the moniker of the open-access KG to Wikidata. To their credit, I think its the right call.

src: I worked in a lab lead by DBPedia's founder (and one of the contributors to the original infobox to KB code).

[0] https://blog.liu.se/olafhartig/2019/01/10/position-statement...

^^This enables, amongst other things, fact's validity to be quantified. Instead of saying , you can now say { } ;

[1] http://downloads.dbpedia.org/current/ (from 2018); http://downloads.dbpedia.org/ (see the folder titled 2016-10)

Re: Wikidata

#22

Some of the comments suggest not everyone is aware of the history. This is a Hacker News thread from March 2012 titled "Wikidata: The first new project from Wikimedia Foundation since 2006" that is interesting to revisit: https://news.ycombinator.com/item?id=3775212

Also, a discussion from 8 months ago:

"A gentle introduction to the Wikidata Query Service"

https://news.ycombinator.com/item?id=24823074

Re: Wikidata

#23

I have frequently created articles and had Wikidata linked to the article. Take https://en.wikipedia.org/wiki/Kate_Baker - if you click on Wikidata item, then it takes you to: https://m.wikidata.org/wiki/Q21536118

Thank you for doing that!

Re: Wikidata

#24
SPARQL over Wikidata is one of the closest things to magic on the Internet. It's incomplete, the runtime is slow, it dies on too much data, but it's amazing being able to think up random questions and actually ask them, however frivolous. Stuff like "who's the most successful footballer from my home town?" or "which part of India has produced the most test cricketers?" is really easy. Makes me wish I'd taken the quantified self more seriously because there's so much I'd love to find out with rich enough linked data.

Re: Wikidata

#25
post #18

Wiki data is awesome. I’ve been considering using it for some projects, but the main thing that’s keeping me away is the concern that some moderator will decide that my data doesn’t fit and remove it. Can anyone speak to this concern? On WP for example notability is a big thing, how does this work in Wikidata?

> I’ve been considering using it for some projects, but the main thing that’s keeping me away is the concern that some moderator will decide that my data doesn’t fit and remove it.

To me the greatest value of Wikidata was making me aware of RDF and SPARQL.

In most cases, if you are relying on data business needs, it would be best to maintain your own RDF dataset and host it either just on HTTP, or on something like https://dydra.com/.

WikiData deseperately needs RDF ingestion, and if this is made available (can be done outside of Wikidata) then it would be easier to periodically sync datasets with Wikidata.

On that note however, you could export all Wikidata triples you need and just host that on your own SPARQL server (e.g. Jena) or use it with RDF tools like rdflib.

Re: Wikidata

#26
post #10

Wikidata is a fantastic data source for all sorts of applications, not just for the Wikimedia projects (infoboxes, templates, etc.). I'm also excited about the Wikifunctions project ( https://en.wikipedia.org/wiki/Wikifunctions ) to created a large body of executable snippets that can be applied to data types. Wikidata is one of the main data sources in my Conzept encyclopedia project: https://conze.pt ( https://twit…

Conzept looks really good! Are there some whitepapers (apart from the user guide) that I can peruse? Some information about the team?

Is this an LOD based solution where we can plug in arbitrary KGs?

Did you fork the UI from some existing Knowledge Graph viz tools, or is it made from scratch?

Re: Wikidata

#27
post #16

Not meaning to be patronising, but what's the point of this thread? Just a Speaker's Corner to say whatever one wants regarding Wikidata?

A bit of that, also making people aware of the wonders of wikidata.

Re: Wikidata

#28
Tests are a bit depressing.

  - "Borane" has two unlinked entries: Q127611 is "any chemical compound composed of boron and hydrogen atoms only" while Q15634214 is specifically boron trihydride. Both correct, but the latter should be labelled as an instance of the former.

  - "Anomalocaris" has Q37395 for the "extinct genus of radiodon" (instance of "fossil taxon") but species (e.g. Q49557506 Anomalocaris cranbrookensis) do not link to it.

  - There are no lists of links, for example Q936518 ("aerospace manufacturer") doesn't have a list of its instances (e.g. Boeing, Q66, or Arado Flugzeugwerke, Q624899).

Re: Wikidata

#29
Wikidata is a great resource, but the SPARQL query language seems more annoyingly complicated and confusing than it could be.

I'm using Wikidata to automatically categorize visited websites and used programs for time tracking purposes.

For example, here's a query to get the entity (e.g. company) that has a specific domain (news.ycombinator.com), and get the categories that entity is in that that are a descendent of the "service on internet" category:

    SELECT distinct ?service ?website_url ?outer_category ?outer_categoryLabel WHERE {
        ?service wdt:P856 ?website_url.
        optional {
            ?service wdt:P31 ?inner_category.
            ?inner_category wdt:P279* ?outer_category.
            ?outer_category wdt:P279+ wd:Q1668024.
        }
        VALUES ?website_url {  }
        SERVICE wikibase:label { bd:serviceParam wikibase:language "en" }
    }
Returns

- social news website - online service - website

Relations have to be written as `wdt:P279` even though they have names [1], and the query engine just silently accepts lots of stuff it shouldn't. For example if above you do `"url"` instead of ``, it will just not return any results because URLs is a separate type and URLs never match strings. And if an entity doesn't exist it will also just not return anything. Then there's this hacky "label service" thing that implicitly creates new output variables (outer_categoryLabel) to make it actually return text.

The UX of the query site [2] is also pretty bad.

I feel like Wikidata would be much more used if it had a easier query language. Or better, real bindings to common languages with full intellisense for properties etc). Something like this:

    const service = wikidata.variable();
    const inner_category = wikidata.variable();
    const outer_category = wikidata.variable();
    const results = await wikidata
        .filter(service.official_website("https://news.ycombinator.com"))
        .filter(service.instance_of(inner_category))
        .filter(inner_category.subclass_of(outer_category).anyDepth())
        .filter(outer_category.subclass_of("service on internet").anyDepth());

    console.log(results.map(row => row.get(outer_category).getLabel({language: "en"})));
It's also really hard to find good answers about the SparQL language without reading hundreds of pages of dry documentation.

[1]: https://phabricator.wikimedia.org/T196450 [2]: https://query.wikidata.org

Re: Wikidata

#30
post #18

Wiki data is awesome. I’ve been considering using it for some projects, but the main thing that’s keeping me away is the concern that some moderator will decide that my data doesn’t fit and remove it. Can anyone speak to this concern? On WP for example notability is a big thing, how does this work in Wikidata?

All data is notable on Wikidata as long as it can be directly sourced, and/or structurally linked to some other data that's itself notable. There's nothing like the concern for the "encyclopedic" that one might find on Wikipedia. The most obvious example of this is the zillions of entries for individual scholarly articles, which are included because these can be endowed with machine-readable info about authors, publi…

Link to the full notability policy on Wikidata: https://wikidata.org/wiki/Wikidata:Notability .

Please read it carefully before creating new items. If the item you want to create is about yourself, your new business or the song you just wrote, it likely does not meet the notability policy.

Post reply on HN