标签：read urlopen urllib agent user url scrapy pytho 复杂
简单爬虫直接diy， 复杂的用scrapy
import urllib2 import re from bs4 import BeautifulSoap req = urllib2.Request(url, headers={‘User-Agent‘ : "Magic Browser"}) webpage= urllib2.urlopen(req) soap = BeautifulSoap(webpage.read()) ...
标签：read urlopen urllib agent user url scrapy pytho 复杂
原文地址：http://www.cnblogs.com/jkmiao/p/6002760.html
