python词频统计

Posted 烈焰之星

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了python词频统计相关的知识,希望对你有一定的参考价值。


词频统计预处理
下载一首英文的歌词或文章
将所有,.?!’:等分隔符全部替换为空格
将所有大写转换为小写
生成单词列表
生成词频统计
排序
排除语法型词汇,代词、冠词、连词
输出词频最大TOP10

s=‘Robert Zoellick, a former US Trade Representative and head of the World Bank, once said: "Trade was more about politics than economics." Indeed, international trade among nations is all about business, but once politicians step in, it becomes polarizing with unexpected consequences that could lead to a trade war.‘ \
‘The ever-boastful US President Donald Trump tweeted that "trade wars are good, and easy to win". His newly appointed top economic advisor, Larry Kudlow, should remind him that trade wars are a pyrrhic form of competition in which even the victor is left worse off.‘ \
‘The US Constitution clearly states: "Congress shall regulate interstate and foreign commerce." It grants authority to the executive branch to negotiate trade agreements, but it has the last word on increasing tariffs, whether it But Trump has no patience to follow such procedures. Instead he is issuing executive orders to satisfy his political base.‘ \
‘The Republicans in Congress were shocked that their leader would take such a protectionist action, recognizing it was more about politics than national security. Their swift opposition forced Trump to make Canada and Mexico exceptions (to be part of North American Free Trade Agreement negotiations), and eventually minimize the effects on the US‘ \
‘There will not be a trade war with these countries. If it occurs, it will be with China. The Trump administration has already taken shots that may spark a trade war, including slapping tariffs on solar panels. The next, and most fierce, battlefield in today‘‘s smartphones to enter the US market. Around the corner is Section 301 of the Trade Act of 1974 — originally intended to safeguard patent rights — that will give the US president the authority to limit China‘
s1=s.replace(‘?‘,‘‘)
s2=s1.replace(‘:‘,‘‘)
s3=s2.replace(‘,‘,‘‘)
s4=s3.replace(‘!‘,‘‘)
s5=s4.replace(‘‘,‘‘)
s6=s5.replace(‘"‘,‘‘)
s7=s6.replace(‘-‘,‘‘)
s8=s7.replace(‘.‘,‘‘)
s9=s8.lower()
list1=s9.split()
for i in list1:
print(i)
myset=set(list1)
print(myset)
key={}
for i in myset:
key[i]=list1.count(i)
print(key[i])
for i in {‘a‘,‘an‘,‘the‘,‘to‘,‘in‘,‘on‘,‘is‘,‘are‘,‘too‘,‘am‘}:
if i in key:
key.pop(i)
sort=sorted(key.items(),key=lambda d:d[1],reverse=True)
for j in range(10):
print(sort[j])




















以上是关于python词频统计的主要内容,如果未能解决你的问题,请参考以下文章

Python 分词后词频统计

python词频统计

Python词频统计

Python 词频统计

经典案例词频统计十种实现方式

python bs4怎么抓豆瓣评论做词频表