Live data from Hacker News

Can Watson save IBM?

ft.com

31–32 of 32 posts

Re: Can Watson save IBM?

#32
post #26
post #25

Earlier quoted context omitted.

Thanks for giving it a try. I agree that particular test does not sound like state-of-the-art. But don't judge the whole package just based on one test of one API. It'd be great to have access to these files (you can email them to me at my YC ID @gmail.com). Best would even be to post your experience on our forum: https://developer.ibm.com/answers/smartspace/watson/ . We are usually pretty responsive.

Sorry I was harsh. I tried the translation service and it work better. Anyway, I don't remember exactly all the articles I tried, but two of them were https://www.cs.princeton.edu/~chazelle/pubs/mst.pdf https://www.cs.ubc.ca/~condon/papers/chungcondon96.pdf while one news that failed to parse was http://www.repubblica.it/economia/2016/02/09/news/borse_9_fe... I tried other articles and news, but I do not recall each…

Hey pathsjs, sorry for the bad experience... Nevertheless, thanks for the feedback. TLDR: I pushed a fix for the bad character issue, and those PDFs should convert now.

The long version: It has to do with the underlying structure of the PDF; some of the characters in the above PDF have glyphs for display but don't actually map the characters to code points. So, when we pull out the text, they come through as invalid characters, which we should have filtered out. This is an issue we've seen with (all?) PDF viewers; the text you copy from a sentence isn't always what you expect... But, we're aware of that shortcoming and are looking at some ways to improve the quality.

In regard to the extra content in the news articles, we're not currently trying to do what BoilerPlate does. If you want to include or exclude specific content from a page, we have config options to do that via XPaths. Though, we're always open to ways of improving our services, and incorporating something like that would probably be useful.

Post reply on HN