25、Python之禅

要求：

爬取网页你好，蜘蛛侠！中的Python之禅中英文版本，并且打印。

 

目的：

练习使用selenium爬取动态网页的信息。

练习selenium与BeautifulSoup的搭配使用。

 

 

URL     https://localprod.pandateacher.com/python-manuscript/hello-spiderman/

 

方法一： 用selenium

 

 from selenium import webdriver
 import time

 driver = webdriver.Chrome()

 driver.get('https://localprod.pandateacher.com/python-manuscript/hello-spiderman/')
 time.sleep(2)

 button = driver.find_element_by_class_name('sub')
 button.click()
 time.sleep(1)

 python_zens = driver.find_elements_by_class_name('content')

 for python_zen in python_zens:
     print(python_zen.find_element_by_tag_name('h1').text,end='\n\n')
     print(python_zen.find_element_by_tag_name('p').text,end='\n\n')

 driver.close()

 The Zen of Python

 Beautiful is better than ugly.
 Explicit is better than implicit.
 Simple is better than complex.
 Complex is better than complicated.
 Flat is better than nested.
 Sparse is better than dense.
 Readability counts.
 Special cases aren't special enough to break the rules.
 Although practicality beats purity.
 Errors should never pass silently.
 Unless explicitly silenced.
 In the face of ambiguity, refuse the temptation to guess.
 There should be one-- and preferably only one --obvious way to do it.
 Although that way may not be obvious at first unless you're Dutch.
 Now is better than never.
 Although never is often better than *right* now.
 If the implementation is hard to explain, it's a bad idea.
 If the implementation is easy to explain, it may be a good idea.
 Namespaces are one honking great idea -- let's do more of those!

 Python之禅

 优美胜于丑陋
 明了胜于晦涩
 简洁胜于复杂
 复杂胜于凌乱
 扁平胜于嵌套
 间隔胜于紧凑
 可读性很重要
 即便假借特例的实用性之名，也不可违背这些规则
 不要包容所有错误，除非你确定需要这样做
 当存在多种可能，不要尝试去猜测
 而是尽量找一种，最好是唯一一种明显的解决方案
 虽然这并不容易，因为你不是 Python 之父
 做也许好过不做，但不假思索就动手还不如不做
 如果你无法向人描述你的方案，那肯定不是一个好方案；反之亦然
 命名空间是一种绝妙的理念，我们应当多加利用

 

方法二：用selenium 和 BeautifulSoup

 

 from selenium import webdriver
 from bs4 import BeautifulSoup
 import time

 driver = webdriver.Chrome()

 driver.get('https://localprod.pandateacher.com/python-manuscript/hello-spiderman/')
 time.sleep(2)

 button = driver.find_element_by_class_name('sub')
 button.click()
 time.sleep(1)

 pagesource = driver.page_source

 soup = BeautifulSoup(pagesource,'html.parser')
 items = soup.find_all(class_='content')
 for item in items:
     print('\n\t'+item.find('h1').text)
     print(item.find('p').text)

 driver.close()

         The Zen of Python

             Beautiful is better than ugly.
             Explicit is better than implicit.
             Simple is better than complex.
             Complex is better than complicated.
             Flat is better than nested.
             Sparse is better than dense.
             Readability counts.
             Special cases aren't special enough to break the rules.
             Although practicality beats purity.
             Errors should never pass silently.
             Unless explicitly silenced.
             In the face of ambiguity, refuse the temptation to guess.
             There should be one-- and preferably only one --obvious way to do it.
             Although that way may not be obvious at first unless you're Dutch.
             Now is better than never.
             Although never is often better than *right* now.
             If the implementation is hard to explain, it's a bad idea.
             If the implementation is easy to explain, it may be a good idea.
             Namespaces are one honking great idea -- let's do more of those!

         Python之禅

             优美胜于丑陋
             明了胜于晦涩
             简洁胜于复杂
             复杂胜于凌乱
             扁平胜于嵌套
             间隔胜于紧凑
             可读性很重要
             即便假借特例的实用性之名，也不可违背这些规则
             不要包容所有错误，除非你确定需要这样做
             当存在多种可能，不要尝试去猜测
             而是尽量找一种，最好是唯一一种明显的解决方案
             虽然这并不容易，因为你不是 Python 之父
             做也许好过不做，但不假思索就动手还不如不做
             如果你无法向人描述你的方案，那肯定不是一个好方案；反之亦然
             命名空间是一种绝妙的理念，我们应当多加利用