- 词频统计预处理
- 下载一首英文的歌词或文章
- 将所有,.？！’:等分隔符全部替换为空格
- 将所有大写转换为小写
- 生成单词列表
- 生成词频统计
- 排序
- 排除语法型词汇，代词、冠词、连词
- 输出词频最大TOP10
song = ‘‘‘ If you say you’re the firework at the bay I wish I could be a wave after the rain, you light up the gray far away you’re the galaxy from space with the stars you kiss my face I’ll go everywhere after your trace when I’m lonely l willearntoembrace I’ll follow you along the way like shadow chasing down the flame I’ll wait for you right on your way come and stay with me if you may I’ll raise my head and look your way tears dropping down and feeling free Some love comes by like hurricane as if I play your losing game If you’re like firefly in summer haze Children laugh around your grace Then I’ll be there, trying to say out your name Look at me, what a tiny helpless me Only dream when you smile at me Maybe you wouldn’t stop just for me Far behind let me stand there singing I’ll follow you along the way like shadow chasing down the flame I’ll wait for you right on your way come and stay with me if you may I’ll raise my head and look your way tears dropping down and feeling free Some love comes by like hurricane but rainbows rise I’ll follow you along the way like shadow chasing down the flame I’ll wait for you right on your way come and stay with me if you may I’ll raise my head and look your way tears dropping down and feeling free Some love comes by like hurricane but rainbows rise after the pain ‘‘‘
#将所有分隔符全部替换为空格,将所有大写转换为小写,以空格划分每个单词 s1 = song.replace(‘’‘,‘ ‘).lower().split() s2 = song.split() #统计各单词出现的次数 c = {} for i in s2: count = s1.count(i) c[i] = count #去掉没意义的单词 word = ‘‘‘ i you you‘re the by up a but my and would when some i‘ll i‘m with on could come from Maybe only out me in at for if your down ‘‘‘ s3 = word.split() for i in s3: if i in c.keys(): del (c[i])
#按每个单词出现的次数进行排序 count = sorted(c.items(),key=lambda items: items[1], reverse=True) #输出词频最大TOP10 for i in range(10): print(count[i])