码迷,mamicode.com
首页 > 其他好文 > 详细

大学排名

时间:2020-05-23 10:01:03      阅读:60      评论:0      收藏:0      [点我收藏+]

标签:return   port   format   str   enc   soup   png   string   try   

import requests
import pandas as pd
import numpy as np
from bs4 import BeautifulSoup
import sqlite3
allUniv=[]
def getHTMLText(url):
    try:
        r=requests.get(url,timeout=30)
        r.raise_for_status()
        r.encoding = utf-8
        return r.text
    except:
        return "error"
def fillUnivList(soup):
    data = soup.find_all(tr)
    for tr in data:
        ltd = tr.find_all(td)
        if len(ltd)==0:
            continue
        singleUniv = []
        for td in ltd:
            singleUniv.append(td.string)
        allUniv.append(singleUniv)
def printUnivList(num):
    with open(rD:\mypython\大学排名30.CSV,w) as f:
        f.write("{1:^2}{2:{0}^10}{3:{0}^6}{4:{0}^4}{5:{0}^10}\n".format((chr(12288)),"排名","学校名称","省市","总分","科研服务"))
        for i in range(num):
            u=allUniv[i]
            f.write("{1:^2}{2:{0}^10}{3:{0}^6}{4:{0}^8.1f}{5:{0}^10}\n".format((chr(12288)),i+1,u[1],u[2],eval(u[3]),u[11]))
        f.close()
    if 1:
        print("successful")
    else:
        print("fail")

def main(num):
    url=http://www.zuihaodaxue.cn/zuihaodaxuepaiming2019.html
    html = getHTMLText(url)
    soup = BeautifulSoup(html,"html.parser")
    fillUnivList(soup)
    printUnivList(num)

main(500)

技术图片

大学排名

标签:return   port   format   str   enc   soup   png   string   try   

原文地址:https://www.cnblogs.com/MARCOREUS11/p/12941028.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!