Live data from Hacker News

Show HN: TextRazor, a scriptable text mining API

textrazor.com

21–30 of 46 posts

Re: Show HN: TextRazor, a scriptable text mining API

#21
post #15
post #12

Earlier quoted context omitted.

The Stanford parser is great, but isn't really the same. The Stanford entity recogniser is limited to the standard types of people, places, companies, but we identify and disambiguate into a far richer ontology from wikipedia, and can recognize topic abstractions that aren't explicitly mentioned. Also we found the Stanford tools (and the other open source NLP tools) were difficult to integrate into "production" apps…

How does your offering compare to Calais from Thomson-Reuters? Edit: To be specific, it looks very similar. What do you have that Calais doesn't?

I have been using the free tier (50K API calls per day) of Open Calais for years and have also used it in code examples in three books I have written.

One thing that Open Calais does that I really like is that they attempt to have a single URI uniquely identifying recognized named entities. This is useful because, for example, when it recognizes President Bill Clinton, you get a reference to a unique URI, even if his name, title is different in different processed texts.

Thomson-Reuters bought ClearForest several years ago, thus acquiring Calais. If you are interested in text mining, and if you haven't experimented with Open Calais, then please put that on your TODO list.

Re: Show HN: TextRazor, a scriptable text mining API

#22
post #14

Earlier quoted context omitted.

Just tried http://nlp.stanford.edu:8080/parser/ it only allows up to 70 characters for parsing.

Try downloading the distribution of code and data and run it locally. Java stuff, maven based, easy to run. Use the example code listed on the installation web page to see how to set it up.

Ahh, thanks. I didn't realize it was just a demo. Sounds like a fun weekend project.

Re: Show HN: TextRazor, a scriptable text mining API

#24
This looks great. I'm building http://dokket.aws.af.cm. It's a database filled with documents from the Federal Communications Commission. From day 1, I've been looking for smart ways to make use of the thousands of documents of unstructured text. The customization you offer seems to be the killer feature for me.

I'll write a Ruby api wrapper if you give me an agreed-upon amount of usage when you settle on pricing.

Feel free to email me (HN name @ gmail) if you're interested or just want to follow up for customer development purposes.

Best of luck!

Re: Show HN: TextRazor, a scriptable text mining API

#26
post #4

Really impressive results. I put in some music reviews, and it did an excellent job of identifying artists, Genres, labels, etc. From an API perspective,there's not much out there that competes with this - and nothing with a modern API.

There are a number of other competing APIs. One of the best is OpenCalais, which is owned by Thomson Reuters[1].

You can demo it with some text here: http://viewer.opencalais.com/

[1] http://www.opencalais.com

Post reply on HN