Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

An analysis of Steve Jobs tribute messages displayed by Apple

neilkodner.com

Post reply on HN
Print view View original

1–10 of 30 posts

Re: An analysis of Steve Jobs tribute messages displayed by Apple

#4

Post by danielpal »

thisduck wrote: post #2

Wouldn't the regex for "mac" also match "macintosh" and "imac" and inflate the numbers?

True, he probably should change the regex to something like "^mac" which would also match macintosh. So "^mac\s" should be fine. I would probably use: ^[M|m]ac[\s|\.]+

Re: An analysis of Steve Jobs tribute messages displayed by Apple

#7

Post by kristofferR »

__rkaup__ wrote: post #3

Why is this blocked by my ISP under "Pornography"?

Because you have a poor ISP. No proper ISP should block anything (except maybe child porn, but that's a slippery slope). Change your DNS to either Google's (8.8.8.8) or OpenDNS.

If you live in a repressive country prohibiting pornography you should get a VPN. I'm satisfied with my choice of strongVPN.com

Re: An analysis of Steve Jobs tribute messages displayed by Apple

#8

Post by neilkod »

thisduck wrote: post #2

Wouldn't the regex for "mac" also match "macintosh" and "imac" and inflate the numbers?

You are all 100% correct about the regex. Before converting the product-identifying matching code to Python, I did it in bash using grep -iw to match whole words.

for i in newton macintosh macbook ibook iie mac iphone ipod imac ipad II+ iigs LaserWriter osx 'apple ?tv' itunes '\]\[' imovie do stevejobs_tribute.txt |wc -l`" echo "$i: `egrep -wi "${i}s?" $INPUTFILE|wc -l`" done

But this was difficult to maintain. I wanted the ability to print a 'friendly' looking product name (the dict's key) and maintain the counts in a variable.

When I made the move from bash to python, I knew that there would be some overlap when I pushed this code (in the name of shipping!). I need to split the sentences into proper tokens and then check each token for a product match. I'm already splitting the sentence into tokens for part-of-speech tagging so it shouldn't be difficult to do.

tl;dr known issue on the Mac regex, I needed to publish it and get back to work!

Re: An analysis of Steve Jobs tribute messages displayed by Apple

#9

Post by __rkaup__ »

kristofferR wrote: post #7
__rkaup__ wrote: post #3

Why is this blocked by my ISP under "Pornography"?

Because you have a poor ISP. No proper ISP should block anything (except maybe child porn, but that's a slippery slope). Change your DNS to either Google's (8.8.8.8) or OpenDNS. If you live in a repressive country prohibiting pornography you should get a VPN. I'm satisfied with my choice of strongVPN.com

Unfortunately, that repressive regime I live in is my mum's house.
Post reply on HN