python nltk 入门demo

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了python nltk 入门demo相关的知识,希望对你有一定的参考价值。

sudo pip install -U pyyaml nltk

 

import nltk
nltk.download()

搞不定,必须代理:

Installing via a proxy web server?

If your web connection uses a proxy server, you should specify the proxy address as follows. In the case of an authenticating proxy, specify a username and password. If the proxy is set to None then this function will attempt to detect the system proxy.

>>> nltk.set_proxy(‘http://proxy.example.com:3128‘, (‘USERNAME‘, ‘PASSWORD‘))
>>> nltk.download()


然后下载:
输入d,下载模块,比如 stopwords等。

import nltk
from nltk.stem.lancaster import LancasterStemmer

def main():
    english_punctuations = set([,, ., :, ;, ?, (, ), [, ], !, @, #, %, $, *])
    stemmer = LancasterStemmer()
    stopwords = set(nltk.corpus.stopwords.words(english))

    sentence = """At eight o‘clock on Thursday morning Arthur didn‘t feel very good. interesting booking store."""
    sentence = sentence.lower()
    tokens = nltk.word_tokenize(sentence)

    for word in tokens:
        if not word in english_punctuations:
            if not word in stopwords:
                word = stemmer.stem(word)
                print word

if __name__ == __main__:
    main()

输出:

eight
o‘clock
thursday
morn
arth
n‘t
feel
good
interest
book
stor

 
















以上是关于python nltk 入门demo的主要内容,如果未能解决你的问题,请参考以下文章

Python: NLTK几个入门函数

python自然语言处理函数库nltk从入门到精通

Python自然语言工具包(NLTK)入门

NLTK入门

自然语言工具包入门

在PyCharm中安装nltk,以及nltk data的下载。