Of course, a word can appear on a page multiple times. That's why, I think, folks used to ignore the stopwords. They introduced noise when trying to access the content words. Now, with span constraints, you can incorporate them into the analysis. So "a matrix" and "the matrix" returns very different results, even without quotes.
Stop Me If You've Seen This Word Before
11–19 of 19 posts
Re: Stop Me If You've Seen This Word Before
#12I think...I'm kind of shooting from the hip here relating it to context modeling in lossless compression schemes like CABAC and PPM.
Could you overcome stop words with some sort of Bayesian phrase matching over some learned hidden states?
Re: Stop Me If You've Seen This Word Before
#13Re: Stop Me If You've Seen This Word Before
#14I ran into a similar problem teaching myself perl a couple years ago by doing a short tutorial then foolishly jumping into a co-worker's code. "What the hell is '$.'? Hmm, well I'm sure Google can help me. What? No matching documents?!? What is this crazy s.o.b. doing here??"
Re: Stop Me If You've Seen This Word Before
#15I ran into a similar problem teaching myself perl a couple years ago by doing a short tutorial then foolishly jumping into a co-worker's code. "What the hell is '$.'? Hmm, well I'm sure Google can help me. What? No matching documents?!? What is this crazy s.o.b. doing here??"
Glad to hear I'm not the only one who's had trouble with this. I remember reading some C code once and I saw some strange operators I had never seen before... ?, if I remember correctly. I eventually figured out they were GCC extensions for "min" and "max", but only after a painful experience trying to get more info out of Google than "here's how you do addition and multiplication in C!"
Re: Stop Me If You've Seen This Word Before
#16I ran into a similar problem teaching myself perl a couple years ago by doing a short tutorial then foolishly jumping into a co-worker's code. "What the hell is '$.'? Hmm, well I'm sure Google can help me. What? No matching documents?!? What is this crazy s.o.b. doing here??"
Glad to hear I'm not the only one who's had trouble with this. I remember reading some C code once and I saw some strange operators I had never seen before... ?, if I remember correctly. I eventually figured out they were GCC extensions for "min" and "max", but only after a painful experience trying to get more info out of Google than "here's how you do addition and multiplication in C!"
Re: Stop Me If You've Seen This Word Before
#17Re: Stop Me If You've Seen This Word Before
#18Re: Stop Me If You've Seen This Word Before
#19I ran into a similar problem teaching myself perl a couple years ago by doing a short tutorial then foolishly jumping into a co-worker's code. "What the hell is '$.'? Hmm, well I'm sure Google can help me. What? No matching documents?!? What is this crazy s.o.b. doing here??"