python bs4 + requests4 简单爬虫

Posted 贝尔塔猫

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了python bs4 + requests4 简单爬虫相关的知识,希望对你有一定的参考价值。

参考链接:

bs4和requests的使用:https://www.cnblogs.com/baojinjin/p/6819389.html

安装pip:https://blog.csdn.net/zwr_20121141/article/details/80293806

# python 3.x 开始自带了pip,如果没有请自信百度安装。
# pip install beautifulsoup4 requests
from bs4 import BeautifulSoup
import requests

res = requests.get(\'https://etherscan.io/token/tokenholderchart/0x86fa049857e0209aa7d9e616f7eb3b3b78ecfdb0?range=10\')
res.encoding=\'gbk\'
soup = BeautifulSoup(res.text,\'html.parser\')
table = soup.select(\'#ContentPlaceHolder1_resultrows table tr\')
myarr = []
for tr in table:
    td = tr.select(\'td\')
    if len(td) > 0:
        Rank = td[0].text;
        Address = td[1].text;
        Quantity = td[2].text;
        Percentage = td[3].text;
        myarr.append({"Rank": Rank, "Address": Address, "Quantity": Quantity, "Percentage": Percentage})
print(myarr)

 

以上是关于python bs4 + requests4 简单爬虫的主要内容,如果未能解决你的问题,请参考以下文章

python bs4 + requests4 简单爬虫

Spider理论系列-bs4

爬虫,基于request,bs4 的简单实例整合

bs4

Python2.7 基于bs4与requests库的网页图片简单爬取

爬虫-BS4