Stanford POS tagger

17th February 2011

System requirement

• Java 1.5+– http://www.java.com/en/download/index.jsp

Part-of-speech name abbreviations

The Penn Treebank English POS tag set1. CC Coordinating conjunction 25. TO to2. CD Cardinal number 26. UH Interjection3. DT Determiner 27. VB Verb,base form 4. EX Existential there 28. VBD Verb, past tense 5. FW Foreignword 29. VBG Verb,gerund/present

6. INPreposition/subordinating participle conjunction 30. VBN Verb, past participle

7. JJ Adjective 31. VBP Verb, non-3rd ps. sing. present 8. JJR Adjective,comparative 32. VBZ Verb,3rd ps. sing. present 9. JJS Adjective, superlative 33. WDT wh-determiner 10. LS Listitem marker 34. WP wh-pronoun 11. MD Modal 35. WP$ Possessive wh-pronoun 12. NN Noun, singular or mass 36. WRB wh-adverb13. NNS Noun, plural 37 #. Pound sign14. NNP Proper noun, singular 38. $ Dollar sign15. NNPS Proper noun, plural 39. . Sentence-finalpunctuation 16. PDT Predeterminer 4 0 . , Comma 17. POS Possessive ending 41. : Colon, semi-colon18. PRP Personal pronoun 42. ( Left bracket character 19. PP$ Possessive pronoun )43 Right bracket character 20. RB Adverb )44 Straight double quote 21. RBR Adverb, comparative 45. ' Leftopen single quote 22. RBS Adverb, superlative 46. " Leftopen double quote 23. RP Particle 47. ' Right close single quote 24. SYM Symbol (mathematical or scientific) 48. " Right closedouble quote

Download

• http://nlp.stanford.edu/software/stanford-postagger-2010-05-26.tgz

GUI

GUI

Command

1. generate a default properties file.2. Tag file.

generate a default properties filecommand

• java -classpath stanford-postagger.jar edu.stanford.nlp.tagger.maxent.MaxentTagger -genprops > myPropsFile.prop

Tag file command

• java -mx300m -classpath stanford-postagger.jar edu.stanford.nlp.tagger.maxent.MaxentTagger -model models/bidirectional-distsim-wsj-0-18.tagger -textFile sample-input.txt > sample-tagged.txt

Command

Result

• sample-input.txt The School of Liberal Arts was originally the Department of Language and Social Studies under the Faculty of Industrial Education.

•sample-tagged.txtThe_DT School_NN of_IN Liberal_JJ Arts_NNS was_VBD originally_RB the_DT Department_NNP of_IN Language_NNP and_CC Social_NNP Studies_NNP under_IN the_DT Faculty_NNP of_IN Industrial_NNP Education_NNP ._.

Q&A