Live data from Hacker News

I am endlessly fascinated with content tagging systems

twitter.com

261–270 of 279 posts

Re: I am endlessly fascinated with content tagging systems

#261

Earlier quoted context omitted.

I second this! Sounds like an interesting read! :)

I third this!

I'll add that if you do write it, email us a heads-up at hn@ycombinator.com so we can consider putting it in the second-chance pool (https://news.ycombinator.com/item?id=26998309).

Re: I am endlessly fascinated with content tagging systems

#262
post #231

Earlier quoted context omitted.

Content tagging in online systems has existed since at least the 1970s, with the earliest example I can think of being MEDLINE https://en.wikipedia.org/wiki/MEDLINE

metadata is not is tagging. keywords are not tagging.

Right, MEDLINE's "tagging" system is MeSH, which is a large controlled vocabulary. MEDLINE does contain bibliographic data + journal keywords, but its real value add is MeSH, which is used for search, related publication identification, etc. in PubMed.

https://en.wikipedia.org/wiki/Medical_Subject_Headings

Re: I am endlessly fascinated with content tagging systems

#263

Earlier quoted context omitted.

The infoboxes are created from a query to Wikidata, which you can query yourself! No scraping necessary! https://query.wikidata.org/ You'll want to learn SPARQL, but if you know SQL it's not so bad to pick up.

As far as I can tell, that is not the case, sadly. Right now it appears that only 3,975 articles have infoboxes auto-generated from Wikidata. [1] The wikitext contains something like "{{Wikidata Infobox ...}}" instead of just "{{Infobox ...}}". If you look up a popular article like Barack Obama [2], it's just a traditional hand-edited infobox. In fact, one of the first lines of data says "Vice President = Joe Biden",…

For sure, thank you for the correction, I was under the impression it's role was broader.

Re: I am endlessly fascinated with content tagging systems

#264

Earlier quoted context omitted.

How much content they've actually put in their tagging system is just as interesting as how the tagging system works.

And the content itself, I'd say. But yeah, I've always been impressed by how detailed and specific their tags were. That's A LOT of work! The power of porn, I guess. And as an added bonus, those tags now power AIs able to generate custom hentai on demand!

Unfortunately, since their tags are so abundant, most of them (mainly the "too specific" ones) are far from exhaustive/complete in term of being actually used. And things like hair colors are extremely subjective so you're not sure if an image is going to be tagged as brown_hair or red_hair.

If you want to find some images by tags, you better stick with more generic ones.

Re: I am endlessly fascinated with content tagging systems

#266

Instagram's tagging system was actually really effective at categorizing content and discovery because each hashtag was treated as a node in a (giant) graph, where each node has multiple properties, including post count (number of posts using a tag), 'velocity' (number of posts using a particular tag per unit time), etc. I could write up a big post about it as I made a study of it in when I created a web app for find…

> could write up a big post about it

Please DO.

Re: I am endlessly fascinated with content tagging systems

#267

Earlier quoted context omitted.

Suppose you have someone who did a bunch of writing in America, then moved to Europe and became famous as an inventor there. Under your proposal, this person has both Location:Europe and Location:USA, and both Occupation:Writer and Occupation:Inventor. They therefore show up for queries for European writers and American inventors, neither of which was intended; I bet we can come up with situations where the false pos…

I think the only feature you need to express this is to be able limit a tag to the context of another tag. It's slightly different than a compound tag because each tag can still be used independently. I experimented with a system like this recently[0] that used two different tag notations that seemed to make the mixing more intuitive. I didn't have enough time to iterate on it further or build it more seriously, but…

That introduces a dependency, or at least ordering, between the concepts of Location and Occupation that I'm not sure should exist, much less which direction it should point. It works for baking:skilled because skill level is inherently part of the property of being a baker, and skill is undefined without a thing to be skilled at, whereas someone can easily reside in a location with no occupation ({Location:USA/Occupation:Layabout}?) or have an occupation with unknown/unfixed location ({Occupation:Inventor/Location:Nomad}?).

And if you try to create a synthetic context to place both tags under, you get... compound tags, or close enough as makes no difference to me. :) I'd 1000x rather start from there, and special case it to return results for each tag individually, than start introducing spurious orderings or dependencies. (ed: maybe it would be clearer to say "composite tags", as in tags composed out of other tags?)

Re: I am endlessly fascinated with content tagging systems

#268
post #257

Earlier quoted context omitted.

We agree on the intended use of the app being more about passive consumption of a feed of interesting content, not active, thorough exploration of particular topics. I'm not sure why you think the whole hashtag system was trash because of this one aspect. Most of the evidence I see is contrary to your statements. To reiterate, the strength of the tagging system is the relationship between the tags you interact with,…

> active, thorough exploration of particular topics > discovery to the level you are describing It is not a thorough or sophisticated search-engine-type task to "use a celebrity's name as a tag to look at pictures of a celebrity". I'm whinging about this because I enjoy Instagram for (yes, largely passive) consumption of the kinds of things people post on Instagram, and I think we should be honest about the brave new…

> unless we are using a definition of "relevant" ..

Yea, this is the crux. Using a particular tag in your post is a prediction that people who appreciate the content clustered around that tag will like your post. A good portion of the time that is based on accuracy, but sometimes it isn't, as I already explained (especially in the most used tags). Instagram was never set up to have the specificity of a search engine.

I agree tags are less useful now, because the feedback loop is broken after Facebook's changes, but it wasn't always like this. Every point I've made is about a particular period in time, not the present.

Re: I am endlessly fascinated with content tagging systems

#269
post #181

Earlier quoted context omitted.

Many comments below are hinting at - but not naming - triplestores. "A has relationship X with B". This is how wikidata works. Learning about those and learning how to query wikidata just blew my mind.

If it isn't too much trouble, I would love to see an example of a particularly complex query that can be done on top of this...Pseudocode or just a text description is fine, it doesn't have to be precise syntax.

I was toying with the first world war at the time. You could query famous soldiers born in the same home town as the current president, for example.
Post reply on HN