爬虫练习

Posted 糖饼好吃

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了爬虫练习相关的知识,希望对你有一定的参考价值。

from bs4 import BeautifulSoup

info = []
with open(‘D:\web1111/new_index.html‘,‘r‘) as wb_data:
Soup = BeautifulSoup(wb_data,‘lxml‘)
images = Soup.select(‘body > div.main-content > ul > li > img‘)
titles = Soup.select(‘body > div.main-content > ul > li > div.article-info > h3 > a‘)
descs = Soup.select(‘body > div.main-content > ul > li > div.article-info > p.description‘)
rates = Soup.select(‘body > div.main-content > ul > li > div.rate > span‘)
cates = Soup.select(‘body > div.main-content > ul > li > div.article-info > p.meta-info‘)
# print (images,titles,descs,rates,cates)

for title,image,desc,rate,cate in zip(titles,images,descs,rates,cates):
data = {
‘title‘ :title.get_text(),
‘rate‘ :rate.get_text(),
‘desc‘ :desc.get_text(),
‘cate‘ :list(cate.stripped_strings),
‘image‘ :image.get(‘src‘)
}
info.append(data)


for i in info:
if float(i[‘rate‘])>3:
print(i[‘title‘],i[‘cate‘])

‘‘‘
body > div.main-content > ul > li:nth-child(1) > div.article-info > h3 > a
body > div.main-content > ul > li:nth-child(1) > div.article-info > p.meta-info > span:nth-child(2)
body > div.main-content > ul > li:nth-child(1) > div.rate > span
body > div.main-content > ul > li:nth-child(1) > div.article-info > p.description
body > div.main-content > ul > li:nth-child(1) > img
‘‘‘

以上是关于爬虫练习的主要内容,如果未能解决你的问题,请参考以下文章

全网最有效爬虫练习,练习完可就业(源代码交流)

爬虫补天练习小爬虫

网络爬虫基础练习

python 爬虫学习练习爬取电影小说

网络爬虫基础练习

网络爬虫基础练习