Python爬虫基础示例

使用pip安装相关依赖：

pip install requests

pip install bs4

安装成功提示：Successfully installed *...

---

爬取中国天气网数据示例代码：

#-*- coding:utf-8 -*-
 
import requests
from bs4 import BeautifulSoup
 
if __name__ == '__main__':
    url = 'http://lishi.tianqi.com/wuhan/201806.html'
    r = requests.get(url)
 
    soup = BeautifulSoup(r.text, 'html.parser')
    weather_div = soup.select('div[class="tqtongji2"]')[0]
    ul_list = weather_div.select('ul')
    for ul in ul_list:
        li_list = ul.select('li')
        print("日期：%s\n最高气温：%s\n最低气温：%s\n天气：%s\n风向：%s\n风力：%s\n" %
              (li_list[0].string.encode('utf-8'),
               li_list[1].string.encode('utf-8'),
               li_list[2].string.encode('utf-8'),
               li_list[3].string.encode('utf-8'),
               li_list[4].string.encode('utf-8'),
               li_list[5].string.encode('utf-8'))
              )

---

执行代码结果：