Pattern: A web mining & natural language processing system for Python
1–10 of 25 posts
Re: Pattern: A web mining & natural language processing system for Python
#2For we who have had to roll some of the same functionality piecemeal out of tools like the Stanford NLP Core, tregex/tsurgeon, Wordnet, Beautiful Soup, and python nlptk, this looks on the surface to be pretty sweet. BSD licensing.
Here's a cool application - tagging negation and speculation clauses in some text (their demo has been trained on biomedical text):
Example sentence: When U937 cells were infected with HIV-1, no induction of NF-KB factor was detected, whereas high level of progeny virions was produced, suggesting that this factor was not required for viral replication.
Result: When U937 cells were infected with HIV-1 , [NEG0 no induction of NF-KB factor was detected NEG0] , whereas high level of progeny virions was produced , [SPEC2 suggesting that this factor was [NEG1 not required for viral replication NEG1] SPEC2] .
Re: Pattern: A web mining & natural language processing system for Python
#3I actually just literally drooled on the keyboard!
Re: Pattern: A web mining & natural language processing system for Python
#4Looks nice, though less full-featured than the NLTK. I'd be interested to see how nice they'd play together and whether applications could exploit the strengths of both at the same time. The only thing that's better than one good NLP framework, is two good NLP frameworks, after all.
Re: Pattern: A web mining & natural language processing system for Python
#5It seems like a very nice tool and many hackers would want to play with it. However, it will be really convenient if the project is put on GitHub.
Re: Pattern: A web mining & natural language processing system for Python
#6Project thats been in the back of my head for a while, but have no time to do:
Analyze HN comments over time with some NLP techniques, maybe sentiment analysis. Then if the next wave of "HN is turning into Reddit" posts comes, point people to the analysis, whatever the conclusions are.
Seems like this would be well suited for the task. Any takers?
Re: Pattern: A web mining & natural language processing system for Python
#7I don't know a whole lot about text analysis and the mentioned algorithms, can this be used to analyze articles and determine which are dealing with the same subject? Techmeme-ish? Or what would be a good starting point for this? (Or would this be better off in an 'Ask HN' post? I am one of those horrible new people on here.)
Re: Pattern: A web mining & natural language processing system for Python
#8The official project page: http://nodebox.net/code/index.php/Perception
Re: Pattern: A web mining & natural language processing system for Python
#9mangstab gan.. like this deh pokoknya.
Re: Pattern: A web mining & natural language processing system for Python
#10I don't know a whole lot about text analysis and the mentioned algorithms, can this be used to analyze articles and determine which are dealing with the same subject? Techmeme-ish? Or what would be a good starting point for this? (Or would this be better off in an 'Ask HN' post? I am one of those horrible new people on here.)
The: "tf-idf + cosine similarity + LSA metrics" bit from Pattern is what you are looking for.