爬虫练习
Posted 糖饼好吃
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了爬虫练习相关的知识,希望对你有一定的参考价值。
from bs4 import BeautifulSoup
info = []
with open(‘D:\web1111/new_index.html‘,‘r‘) as wb_data:
Soup = BeautifulSoup(wb_data,‘lxml‘)
images = Soup.select(‘body > div.main-content > ul > li > img‘)
titles = Soup.select(‘body > div.main-content > ul > li > div.article-info > h3 > a‘)
descs = Soup.select(‘body > div.main-content > ul > li > div.article-info > p.description‘)
rates = Soup.select(‘body > div.main-content > ul > li > div.rate > span‘)
cates = Soup.select(‘body > div.main-content > ul > li > div.article-info > p.meta-info‘)
# print (images,titles,descs,rates,cates)
for title,image,desc,rate,cate in zip(titles,images,descs,rates,cates):
data = {
‘title‘ :title.get_text(),
‘rate‘ :rate.get_text(),
‘desc‘ :desc.get_text(),
‘cate‘ :list(cate.stripped_strings),
‘image‘ :image.get(‘src‘)
}
info.append(data)
for i in info:
if float(i[‘rate‘])>3:
print(i[‘title‘],i[‘cate‘])
‘‘‘
body > div.main-content > ul > li:nth-child(1) > div.article-info > h3 > a
body > div.main-content > ul > li:nth-child(1) > div.article-info > p.meta-info > span:nth-child(2)
body > div.main-content > ul > li:nth-child(1) > div.rate > span
body > div.main-content > ul > li:nth-child(1) > div.article-info > p.description
body > div.main-content > ul > li:nth-child(1) > img
‘‘‘
以上是关于爬虫练习的主要内容,如果未能解决你的问题,请参考以下文章