IBM Watson's team Q&A on reddit
blog.reddit.com
IBM Watson's team Q&A on reddit
1–10 of 30 posts
Re: IBM Watson's team Q&A on reddit
#2Some interesting nuggets in here, I had watched the Nova specials on Watson etc. I would have liked to have had a question about the team, their work stress etc., but otherwise a fun read. I especially enjoyed the step by step parsing and examination of a question in the process of how Watson would work through it.
Re: IBM Watson's team Q&A on reddit
#3I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
Re: IBM Watson's team Q&A on reddit
#4Some interesting nuggets in here, I had watched the Nova specials on Watson etc. I would have liked to have had a question about the team, their work stress etc., but otherwise a fun read. I especially enjoyed the step by step parsing and examination of a question in the process of how Watson would work through it.
[deleted]
Re: IBM Watson's team Q&A on reddit
#5I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
From the Q&A with Ken Jennings: http://live.washingtonpost.com/jeopardy-ken-jennings.html?hp...
Q: Seemed to me, for many of the questions, that the computer was just
better at buzzing in. Does Watson have an unfair advantage for timing the
buzz-in?
A: As Jeopardy devotees know, if you're trying to win on the show, the buzzer is
all. On any given night, nearly all the contestants know nearly all the
answers, so it's just a matter of who masters buzzer rhythm the best.
Watson does have a big advantage in this regard, since it can knock out a
microsecond-precise buzz every single time with little or no variation. Human
reflexes can't compete with computer circuits in this regard. But I wouldn't
call this unfair...precise timing just happens to be one thing computers are
better at than we humans. It's not like I think Watson should try buzzing in
more erratically just to give homo sapiens a chance.Re: IBM Watson's team Q&A on reddit
#6I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
From the Q&A with Ken Jennings: http://live.washingtonpost.com/jeopardy-ken-jennings.html?hp... Q: Seemed to me, for many of the questions, that the computer was just better at buzzing in. Does Watson have an unfair advantage for timing the buzz-in? A: As Jeopardy devotees know, if you're trying to win on the show, the buzzer is all. On any given night, nearly all the contestants know nearly all the answers, so it's…
Homo sapiens didn't have a chance in the first place.
Re: IBM Watson's team Q&A on reddit
#7I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
while yes human reaction times are nowhere near as good as those achievable with computers I think the physical pressing of the buzzer was enough to level the playing field. I can't remember where I read it but it seems that at most Watson had 100ms of an advantage if he was confident of his answer before the buzzers opened. I also can't think of a consistent way of getting rid of this time gap.
Re: IBM Watson's team Q&A on reddit
#8Question 3 was the most interesting but data on parsing remarkably incomplete. As far as I can tell, we have only lists of possible ways to break down the data without any explanation of how or why one possible way is preferred to another.
Case in point (1):How it decides to treat "Treasure Island" as a proper noun. We see only "modifies(Treasure, Island)" -- indicating that it treats treasure and adjective modifying island, then suddenly in the semantic assumption phase they are treated as a compound.
Case in point (2). We are given:
island(Treasure Island)
location(Treasure Island)
resort(Treasure Island)
book(Treasure Island)
movie(Treasure Island)
Case in point (3) : "Builds different semantic queries based on phrases, keywords and semantic assumptions." This is very vague but indicates that Watson generate a set of queries which it runs against its own internal search engine ranking answers presumably based on the quality of the initial search and the confidence of the answer. Would be very very cool to have an example.
All in all, wets the appetite but leaves one wishing for more hearty fare (or a job at IBM!).
Re: IBM Watson's team Q&A on reddit
#9I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
From the Q&A with Ken Jennings: http://live.washingtonpost.com/jeopardy-ken-jennings.html?hp... Q: Seemed to me, for many of the questions, that the computer was just better at buzzing in. Does Watson have an unfair advantage for timing the buzz-in? A: As Jeopardy devotees know, if you're trying to win on the show, the buzzer is all. On any given night, nearly all the contestants know nearly all the answers, so it's…
Agreed. I don't want them to offset Watson's raw potential, but why not just acknowledge the processing power put him ahead of the buzzer.
Re: IBM Watson's team Q&A on reddit
#10I also feel that they sort of jogged around the buzzing in question. Obviously Watson has to calculate and decide his answer, but there is no denying that he was very fast on the buzzer in the game.
From the Q&A with Ken Jennings: http://live.washingtonpost.com/jeopardy-ken-jennings.html?hp... Q: Seemed to me, for many of the questions, that the computer was just better at buzzing in. Does Watson have an unfair advantage for timing the buzz-in? A: As Jeopardy devotees know, if you're trying to win on the show, the buzzer is all. On any given night, nearly all the contestants know nearly all the answers, so it's…
Seems to me they should have chosen harder questions.
They should try to pick questions such that the contestants only know about 1/3 of them.
Then lets see how the computer does.
This is (should be) a contest of knowledge not buzzing.