(python)查看糗事百科文字 点赞 作者 等级 评论
Posted zhentaofrezt
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了(python)查看糗事百科文字 点赞 作者 等级 评论相关的知识,希望对你有一定的参考价值。
import requests
import re
headers = {
‘User-Agent‘:‘Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Win64; x64; Trident/5.0)‘
}
info_lists = []
def judgment_sex(class_name):
if class_name == ‘womenIcon‘:
return ‘女‘
else:
return ‘男‘
def get_info(url):
res = requests.get(url)
ids = re.findall(‘<h2>(.*?)</h2>‘,res.text,re.S)
levels = re.findall(‘<div class="articleGender (.*?)">‘,res.text,re.S)
sexs = re.findall(‘<div class="number">‘,res.text,re.S)
contents = re.findall(‘<div class="content">.*?<span>(.*?)</span>‘,res.text,re.S)
laughs = re.findall(‘<span class="stats-vote"><i class="number">(d+)<i>‘,res.text,re.S)
comments = re.findall(‘<i class="number">(d+)</i>评论‘,res.text,re.S)
for id,level,sex,content,laugh,comment in zip(ids,levels,sexs,contents,laughs,comments):
info = {
‘id‘:id,
‘level‘:level,
‘sex‘:judgment_sex(sex),
‘content‘:content,
‘laugh‘:laugh,
‘comment‘:comment
}
info_lists.append(info)
if __name__ == ‘__main__‘:
urls = [‘https://www.qiushibaike.com/text/page/{}/‘.format(str(i)) for i in range(1,12)]
for url in urls:
get_info(url)
for info_list in info_lists:
f = open(‘E:/qiushi.text‘, ‘a+‘)
try:
f.write(info_list[‘id‘]+‘
‘)
f.write(info_list[‘level‘]+‘
‘)
f.write(info_list[‘sex‘]+‘
‘)
f.write(info_list[‘content‘]+‘
‘)
f.write(info_list[‘laugh‘]+‘
‘)
f.write(info_list[‘comment‘]+‘
‘)
f.close()
except UnicodeEncodeError:
pass
问题:无法生成文档 debug无错
以上是关于(python)查看糗事百科文字 点赞 作者 等级 评论的主要内容,如果未能解决你的问题,请参考以下文章