25Python之禅

Posted 2021-11-29 www1707

要求：

爬取网页你好，蜘蛛侠！中的Python之禅中英文版本，并且打印。

 

目的：

练习使用selenium爬取动态网页的信息。

练习selenium与BeautifulSoup的搭配使用。

 

 

URL     https://localprod.pandateacher.com/python-manuscript/hello-spiderman/

 

方法一： 用selenium

 

 1 from selenium import webdriver
 2 import time
 3 
 4 driver = webdriver.Chrome()
 5 
 6 driver.get(‘https://localprod.pandateacher.com/python-manuscript/hello-spiderman/‘)
 7 time.sleep(2)
 8 
 9 button = driver.find_element_by_class_name(‘sub‘)
10 button.click()
11 time.sleep(1)
12 
13 python_zens = driver.find_elements_by_class_name(‘content‘)
14 
15 for python_zen in python_zens:
16     print(python_zen.find_element_by_tag_name(‘h1‘).text,end=‘\\n\\n‘)
17     print(python_zen.find_element_by_tag_name(‘p‘).text,end=‘\\n\\n‘)
18 
19 driver.close()

 1 The Zen of Python
 2 
 3 Beautiful is better than ugly.
 4 Explicit is better than implicit.
 5 Simple is better than complex.
 6 Complex is better than complicated.
 7 Flat is better than nested.
 8 Sparse is better than dense.
 9 Readability counts.
10 Special cases aren‘t special enough to break the rules.
11 Although practicality beats purity.
12 Errors should never pass silently.
13 Unless explicitly silenced.
14 In the face of ambiguity, refuse the temptation to guess.
15 There should be one-- and preferably only one --obvious way to do it.
16 Although that way may not be obvious at first unless you‘re Dutch.
17 Now is better than never.
18 Although never is often better than *right* now.
19 If the implementation is hard to explain, it‘s a bad idea.
20 If the implementation is easy to explain, it may be a good idea.
21 Namespaces are one honking great idea -- let‘s do more of those!
22 
23 Python之禅
24 
25 优美胜于丑陋
26 明了胜于晦涩
27 简洁胜于复杂
28 复杂胜于凌乱
29 扁平胜于嵌套
30 间隔胜于紧凑
31 可读性很重要
32 即便假借特例的实用性之名，也不可违背这些规则
33 不要包容所有错误，除非你确定需要这样做
34 当存在多种可能，不要尝试去猜测
35 而是尽量找一种，最好是唯一一种明显的解决方案
36 虽然这并不容易，因为你不是 Python 之父
37 做也许好过不做，但不假思索就动手还不如不做
38 如果你无法向人描述你的方案，那肯定不是一个好方案；反之亦然
39 命名空间是一种绝妙的理念，我们应当多加利用

 

方法二：用selenium 和 BeautifulSoup

 

 1 from selenium import webdriver
 2 from bs4 import BeautifulSoup
 3 import time
 4 
 5 driver = webdriver.Chrome()
 6 
 7 driver.get(‘https://localprod.pandateacher.com/python-manuscript/hello-spiderman/‘)
 8 time.sleep(2)
 9 
10 button = driver.find_element_by_class_name(‘sub‘)
11 button.click()
12 time.sleep(1)
13 
14 pagesource = driver.page_source
15 
16 soup = BeautifulSoup(pagesource,‘html.parser‘)
17 items = soup.find_all(class_=‘content‘)
18 for item in items:
19     print(‘\\n\\t‘+item.find(‘h1‘).text)
20     print(item.find(‘p‘).text)
21 
22 driver.close()

 1         The Zen of Python
 2 
 3             Beautiful is better than ugly.
 4             Explicit is better than implicit.
 5             Simple is better than complex.
 6             Complex is better than complicated.
 7             Flat is better than nested.
 8             Sparse is better than dense.
 9             Readability counts.
10             Special cases aren‘t special enough to break the rules.
11             Although practicality beats purity.
12             Errors should never pass silently.
13             Unless explicitly silenced.
14             In the face of ambiguity, refuse the temptation to guess.
15             There should be one-- and preferably only one --obvious way to do it.
16             Although that way may not be obvious at first unless you‘re Dutch.
17             Now is better than never.
18             Although never is often better than *right* now.
19             If the implementation is hard to explain, it‘s a bad idea.
20             If the implementation is easy to explain, it may be a good idea.
21             Namespaces are one honking great idea -- let‘s do more of those!
22 
23         Python之禅
24 
25             优美胜于丑陋
26             明了胜于晦涩
27             简洁胜于复杂
28             复杂胜于凌乱
29             扁平胜于嵌套
30             间隔胜于紧凑
31             可读性很重要
32             即便假借特例的实用性之名，也不可违背这些规则
33             不要包容所有错误，除非你确定需要这样做
34             当存在多种可能，不要尝试去猜测
35             而是尽量找一种，最好是唯一一种明显的解决方案
36             虽然这并不容易，因为你不是 Python 之父
37             做也许好过不做，但不假思索就动手还不如不做
38             如果你无法向人描述你的方案，那肯定不是一个好方案；反之亦然
39             命名空间是一种绝妙的理念，我们应当多加利用