5.13 第一次爬虫和测试

Posted hrunjie

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了5.13 第一次爬虫和测试相关的知识,希望对你有一定的参考价值。

 1 import requests
 2 from bs4 import BeautifulSoup
 3 
 4 count = 0
 5 for x in range(20):
 6     count += 1
 7     res_web = requests.get(https://www.baidu.com/)         (由于谷歌网站遭遇反爬虫,于是改为百度网站)
 8     print(第{}次的响应码为:{}.format(count, res_web.status_code))
 9     bs_web = BeautifulSoup(res_web.text, html.parser)
10 
11 print(text, content的数值分别为:{},{}.format(len(res_web.text),len(res_web.content)))

第1次的响应码为:200
第2次的响应码为:200
第3次的响应码为:200
第4次的响应码为:200
第5次的响应码为:200
第6次的响应码为:200
第7次的响应码为:200
第8次的响应码为:200
第9次的响应码为:200
第10次的响应码为:200
第11次的响应码为:200
第12次的响应码为:200
第13次的响应码为:200
第14次的响应码为:200
第15次的响应码为:200
第16次的响应码为:200
第17次的响应码为:200
第18次的响应码为:200
第19次的响应码为:200
第20次的响应码为:200
text, content的长度值分别为:2443,2443

 1 import requests, csv
 2 from bs4 import BeautifulSoup
 3 
 4 res_univer = requests.get(http://www.zuihaodaxue.com/zuihaodaxuepaiming2017.html)
 5 res_univer.encoding = utf-8
 6 bs_univer = BeautifulSoup(res_univer.text, html.parser)
 7 
 8 list_all_univer = bs_univer.find_all(tr)[1:501]
 9 count = 0
10 
11 with open(university.csv, w, encoding=gbk) as file_1:
12     writer = csv.writer(file_1)
13     for list_a_univer in list_all_univer:
14         count += 1
15         data = list_a_univer.find_all(td)
16         writer.writerow([{},{},{},{}.format(count, data[1].text, data[2].text, data[3].text)])
17       

 

 

 

"1,清华大学,北京,94.0 "
"2,北京大学,北京,81.2 "
"3,浙江大学,浙江,77.8 "
"4,上海交通大学,上海,77.5 "
"5,复旦大学,上海,71.1 "
"6,中国科学技术大学,安徽,65.9 "
"7,南京大学,江苏,65.3 "
"8,华中科技大学,湖北,63.0 "
"9,中山大学,广东,62.7 "
"10,哈尔滨工业大学,黑龙江,61.6 "
"11,同济大学,上海,60.8 "
"12,东南大学,江苏,59.8 "
"13,武汉大学,湖北,58.4 "
"14,北京航空航天大学,北京,58.3 "
"15,南开大学,天津,58.2 "
"16,四川大学,四川,57.4 "
"17,西安交通大学,陕西,57.4 "
"18,天津大学,天津,56.2 "
"19,华南理工大学,广东,56.1 "
"20,北京师范大学,北京,55.1 "
"21,厦门大学,福建,55.0 "
"22,山东大学,山东,54.5 "
"23,大连理工大学,辽宁,54.1 "
"24,吉林大学,吉林,53.9 "
"25,北京理工大学,北京,53.1 "
"26,中南大学,湖南,52.4 "
"27,对外经济贸易大学,北京,51.9 "
"28,苏州大学,江苏,51.7 "
"29,中国人民大学,北京,51.7 "
"30,西北工业大学,陕西,51.1 "
"31,湖南大学,湖南,50.7 "
"32,华东理工大学,上海,50.0 "
"33,华东师范大学,上海,50.0 "
"34,电子科技大学,四川,49.4 "
"35,重庆大学,重庆,49.3 "
"36,南京航空航天大学,江苏,49.1 "
"37,北京科技大学,北京,48.9 "
"38,上海财经大学,上海,48.8 "
"39,南京理工大学,江苏,48.0 "
"40,中国农业大学,北京,48.0 "
"41,北京交通大学,北京,47.4 "
"42,北京化工大学,北京,47.1 "
"43,首都医科大学,北京,47.1 "
"44,福州大学,福建,46.7 "
"45,武汉理工大学,湖北,46.7 "
"46,中央财经大学,北京,46.7 "
"47,北京邮电大学,北京,46.6 "
"48,东华大学,上海,46.6 "
"49,华中师范大学,湖北,46.6 "
"50,上海大学,上海,46.5 "
"51,西安电子科技大学,陕西,46.2 "
"52,北京协和医学院,北京,45.9 "
"53,天津医科大学,天津,45.7 "
"54,华北电力大学,北京,45.5 "
"55,东北大学,辽宁,45.3 "
"56,东北师范大学,吉林,45.3 "
"57,暨南大学,广东,45.2 "
"58,兰州大学,甘肃,45.0 "
"59,江南大学,江苏,44.8 "
"60,南京医科大学,江苏,44.8 "
"61,中国海洋大学,山东,44.7 "
"62,上海外国语大学,上海,44.5 "
"63,中国地质大学(北京),北京,44.3 "
"64,西南财经大学,四川,44.1 "
"65,中国地质大学(武汉),湖北,44.0 "
"66,华中农业大学,湖北,43.9 "
"67,南方医科大学,广东,43.9 "
"68,合肥工业大学,安徽,43.6 "
"69,中国医科大学,辽宁,43.5 "
"70,西南大学,重庆,43.4 "
"71,南京农业大学,江苏,43.3 "
"72,中国药科大学,江苏,43.3 "
"73,中南财经政法大学,湖北,43.3 "
"74,哈尔滨工程大学,黑龙江,43.2 "
"75,中国石油大学(北京),北京,43.2 "
"76,浙江工业大学,浙江,43.0 "
"77,东北财经大学,辽宁,42.9 "
"78,河海大学,江苏,42.9 "
"79,中国矿业大学,江苏,42.9 "
"80,北京工业大学,北京,42.8 "
"81,中国石油大学(华东),山东,42.8 "
"82,广东外语外贸大学,广东,42.7 "
"83,南京师范大学,江苏,42.4 "
"84,中国政法大学,北京,42.3 "
"85,北京中医药大学,北京,42.0 "
"86,西南交通大学,四川,42.0 "
"87,华南师范大学,广东,41.9 "
"88,中国传媒大学,北京,41.9 "
"89,北京林业大学,北京,41.7 "
"90,江苏大学,江苏,41.7 "
"91,深圳大学,广东,41.7 "
"92,汕头大学,广东,41.6 "
"93,首都经济贸易大学,北京,41.6 "
"94,西北农林科技大学,陕西,41.6 "
"95,浙江师范大学,浙江,41.5 "
"96,安徽大学,安徽,41.3 "
"97,大连医科大学,辽宁,41.2 "
"98,浙江理工大学,浙江,41.2 "
"99,南京邮电大学,江苏,41.1 "
"100,华侨大学,福建,41.0 "
"101,宁波大学,浙江,41.0 "
"102,西北大学,陕西,40.8 "
"103,南京工业大学,江苏,40.7 "
"104,上海中医药大学,上海,40.7 "
"105,陕西师范大学,陕西,40.3 "
"106,首都师范大学,北京,40.3 "
"107,西交利物浦大学,江苏,40.3 "
"108,杭州电子科技大学,浙江,40.1 "
"109,杭州师范大学,浙江,40.0 "
"110,燕山大学,河北,40.0 "
"111,大连海事大学,辽宁,39.8 "
"112,河北工业大学,河北,39.8 "
"113,南京信息工程大学,江苏,39.8 "
"114,中央民族大学,北京,39.7 "
"115,沈阳药科大学,辽宁,39.6 "
"116,天津财经大学,天津,39.5 "
"117,哈尔滨医科大学,黑龙江,39.3 "
"118,浙江工商大学,浙江,39.1 "
"119,长安大学,陕西,39.0 "
"120,湘潭大学,湖南,39.0 "
"121,云南大学,云南,38.9 "
"122,重庆医科大学,重庆,38.7 "
"123,南京财经大学,江苏,38.7 "
"124,上海理工大学,上海,38.7 "
"125,湖北大学,湖北,38.6 "
"126,湖南师范大学,湖南,38.6 "
"127,扬州大学,江苏,38.5 "
"128,温州医科大学,浙江,38.3 "
"129,浙江财经大学,浙江,38.3 "
"130,安徽医科大学,安徽,38.2 "
"131,福建医科大学,福建,38.2 "
"132,广东工业大学,广东,38.1 "
"133,广州医科大学,广东,37.9 "
"134,河北医科大学,河北,37.9 "
"135,辽宁大学,辽宁,37.9 "
"136,上海师范大学,上海,37.9 "
"137,河北大学,河北,37.7 "
"138,华南农业大学,广东,37.7 "
"139,南昌大学,江西,37.6 "
"140,太原理工大学,山西,37.6 "
"141,南京审计大学,江苏,37.5 "
"142,广西大学,广西,37.4 "
"143,山西大学,山西,37.3 "
"144,郑州大学,河南,37.3 "
"145,广西医科大学,广西,37.1 "
"146,东北林业大学,黑龙江,37.0 "
"147,东北农业大学,黑龙江,36.9 "
"148,武汉科技大学,湖北,36.8 "
"149,石家庄铁道大学,河北,36.7 "
"150,渤海大学,辽宁,36.6 "
"151,安徽师范大学,安徽,36.4 "
"152,长沙理工大学,湖南,36.3 "
"153,福建师范大学,福建,36.3 "
"154,黑龙江大学,黑龙江,36.3 "
"155,江西财经大学,江西,36.3 "
"156,广州大学,广东,36.2 "
"157,北京工商大学,北京,36.1 "
"158,河北师范大学,河北,36.1 "
"159,三峡大学,湖北,36.1 "
"160,天津师范大学,天津,36.1 "
"161,温州大学,浙江,36.1 "
"162,安徽工业大学,安徽,35.9 "
"163,河北科技大学,河北,35.9 "
"164,青岛大学,山东,35.8 "
"165,辽宁工业大学,辽宁,35.7 "
"166,上海海事大学,上海,35.7 "
"167,徐州医科大学,江苏,35.6 "
"168,天津工业大学,天津,35.5 "
"169,北京体育大学,北京,35.4 "
"170,四川农业大学,四川,35.4 "
"171,西安理工大学,陕西,35.3 "
"172,河南大学,河南,35.2 "
"173,武汉工程大学,湖北,35.2 "
"174,广州中医药大学,广东,35.1 "
"175,天津中医药大学,天津,35.1 "
"176,重庆邮电大学,重庆,35.0 "
"177,济南大学,山东,35.0 "
"178,闽南师范大学,福建,35.0 "
"179,北京建筑大学,北京,34.9 "
"180,重庆工商大学,重庆,34.8 "
"181,福建农林大学,福建,34.8 "
"182,青岛科技大学,山东,34.8 "
"183,沈阳航空航天大学,辽宁,34.8 "
"184,河北农业大学,河北,34.7 "
"185,江苏师范大学,江苏,34.7 "
"186,浙江农林大学,浙江,34.7 "
"187,北方工业大学,北京,34.6 "
"188,天津理工大学,天津,34.6 "
"189,西安建筑科技大学,陕西,34.6 "
"190,中国计量大学,浙江,34.5 "
"191,长春理工大学,吉林,34.4 "
"192,中国民航大学,天津,34.4 "
"193,中南民族大学,湖北,34.4 "
"194,福建中医药大学,福建,34.3 "
"195,海南大学,海南,34.3 "
"196,集美大学,福建,34.3 "
"197,南通大学,江苏,34.3 "
"198,黑龙江中医药大学,黑龙江,34.2 "
"199,湖南农业大学,湖南,34.2 "
"200,辽宁师范大学,辽宁,34.1 "
"201,上海海洋大学,上海,34.1 "
"202,南京中医药大学,江苏,34.0 "
"203,宁夏医科大学,宁夏,34.0 "
"204,浙江中医药大学,浙江,34.0 "
"205,广西师范大学,广西,33.9 "
"206,云南师范大学,云南,33.9 "
"207,山东师范大学,山东,33.8 "
"208,北京物资学院,北京,33.7 "
"209,沈阳医学院,辽宁,33.7 "
"210,河南师范大学,河南,33.6 "
"211,西南石油大学,四川,33.6 "
"212,常州大学,江苏,33.5 "
"213,山西财经大学,山西,33.5 "
"214,承德医学院,河北,33.4 "
"215,江西师范大学,江西,33.4 "
"216,新乡医学院,河南,33.4 "
"217,延边大学,吉林,33.4 "
"218,重庆交通大学,重庆,33.3 "
"219,昆明医科大学,云南,33.3 "
"220,湖州师范学院,浙江,33.2 "
"221,山西师范大学,山西,33.2 "
"222,天津科技大学,天津,33.2 "
"223,河北经贸大学,河北,33.1 "
"224,内蒙古大学,内蒙古,33.1 "
"225,信阳师范学院,河南,33.1 "
"226,长江大学,湖北,33.0 "
"227,河南理工大学,河南,33.0 "
"228,南华大学,湖南,33.0 "
"229,武汉轻工大学,湖北,33.0 "
"230,广东医科大学,广东,32.9 "
"231,河北北方学院,河北,32.9 "
"232,上海立信会计学院,上海,32.9 "
"233,广东药科大学,广东,32.8 "
"234,山东科技大学,山东,32.8 "
"235,苏州科技大学,江苏,32.8 "
"236,北京信息科技大学,北京,32.7 "
"237,黄冈师范学院,湖北,32.7 "
"238,湖南科技大学,湖南,32.6 "
"239,陕西科技大学,陕西,32.6 "
"240,重庆师范大学,重庆,32.5 "
"241,湖南工业大学,湖南,32.5 "
"242,江汉大学,湖北,32.5 "
"243,江苏科技大学,江苏,32.5 "
"244,中南林业科技大学,湖南,32.5 "
"245,东北电力大学,吉林,32.4 "
"246,山东财经大学,山东,32.4 "
"247,华北理工大学,河北,32.3 "
"248,山东农业大学,山东,32.3 "
"249,西南医科大学,四川,32.3 "
"250,中北大学,山西,32.3 "
"251,成都理工大学,四川,32.2 "
"252,广东财经大学,广东,32.2 "
"253,西安邮电大学,陕西,32.2 "
"254,浙江科技学院,浙江,32.2 "
"255,安徽农业大学,安徽,32.0 "
"256,昆明理工大学,云南,32.0 "
"257,宁夏大学,宁夏,32.0 "
"258,锦州医科大学,辽宁,31.8 "
"259,烟台大学,山东,31.8 "
"260,贵州大学,贵州,31.7 "
"261,吉林师范大学,吉林,31.7 "
"262,山西医科大学,山西,31.7 "
"263,绍兴文理学院,浙江,31.7 "
"264,沈阳农业大学,辽宁,31.7 "
"265,广西民族大学,广西,31.6 "
"266,兰州交通大学,甘肃,31.6 "
"267,闽江学院,福建,31.6 "
"268,沈阳建筑大学,辽宁,31.6 "
"269,西北师范大学,甘肃,31.6 "
"270,大连交通大学,辽宁,31.5 "
"271,湖北师范大学,湖北,31.5 "
"272,南京林业大学,江苏,31.5 "
"273,青岛理工大学,山东,31.5 "
"274,上海电力学院,上海,31.5 "
"275,广东技术师范学院,广东,31.4 "
"276,河南科技大学,河南,31.4 "
"277,淮北师范大学,安徽,31.4 "
"278,辽宁中医药大学,辽宁,31.4 "
"279,上海第二工业大学,上海,31.4 "
"280,沈阳师范大学,辽宁,31.4 "
"281,哈尔滨师范大学,黑龙江,31.3 "
"282,沈阳工业大学,辽宁,31.3 "
"283,厦门理工学院,福建,31.3 "
"284,常熟理工学院,江苏,31.2 "
"285,哈尔滨理工大学,黑龙江,31.2 "
"286,河南工业大学,河南,31.2 "
"287,桂林电子科技大学,广西,31.1 "
"288,兰州理工大学,甘肃,31.1 "
"289,浙江海洋大学,浙江,31.1 "
"290,大连大学,辽宁,31.0 "
"291,河北地质大学,河北,31.0 "
"292,西华师范大学,四川,31.0 "
"293,大连海洋大学,辽宁,30.9 "
"294,大连民族大学,辽宁,30.9 "
"295,曲阜师范大学,山东,30.9 "
"296,唐山学院,河北,30.9 "
"297,广东海洋大学,广东,30.8 "
"298,河北工程大学,河北,30.8 "
"299,河南农业大学,河南,30.8 "
"300,嘉兴学院,浙江,30.8 "
"301,石家庄学院,河北,30.8 "
"302,海南医学院,海南,30.6 "
"303,河南中医药大学,河南,30.6 "
"304,淮阴师范学院,江苏,30.6 "
"305,上海应用技术大学,上海,30.6 "
"306,郑州航空工业管理学院,河南,30.6 "
"307,大连工业大学,辽宁,30.5 "
"308,辽宁工程技术大学,辽宁,30.5 "
"309,太原科技大学,山西,30.5 "
"310,郑州师范学院,河南,30.5 "
"311,大理大学,云南,30.4 "
"312,桂林理工大学,广西,30.4 "
"313,桂林医学院,广西,30.4 "
"314,上海工程技术大学,上海,30.4 "
"315,石河子大学,新疆,30.4 "
"316,北京印刷学院,北京,30.3 "
"317,长春工业大学,吉林,30.3 "
"318,成都中医药大学,四川,30.3 "
"319,海南师范大学,海南,30.3 "
"320,长春大学,吉林,30.2 "
"321,广西中医药大学,广西,30.2 "
"322,四川师范大学,四川,30.2 "
"323,唐山师范学院,河北,30.2 "
"324,华东交通大学,江西,30.1 "
"325,吉首大学,湖南,30.1 "
"326,南昌航空大学,江西,30.1 "
"327,西南民族大学,四川,30.1 "
"328,安徽理工大学,安徽,30.0 "
"329,安阳师范学院,河南,30.0 "
"330,川北医学院,四川,30.0 "
"331,东北石油大学,黑龙江,30.0 "
"332,福建工程学院,福建,30.0 "
"333,哈尔滨商业大学,黑龙江,30.0 "
"334,天津商业大学,天津,30.0 "
"335,长治医学院,山西,29.9 "
"336,湖北工程学院,湖北,29.9 "
"337,西安财经学院,陕西,29.9 "
"338,西安石油大学,陕西,29.9 "
"339,广西师范学院,广西,29.8 "
"340,宁波工程学院,浙江,29.8 "
"341,廊坊师范学院,河北,29.7 "
"342,东莞理工学院,广东,29.6 "
"343,湖南理工学院,湖南,29.6 "
"344,西南科技大学,四川,29.6 "
"345,蚌埠医学院,安徽,29.5 "
"346,齐齐哈尔医学院,黑龙江,29.5 "
"347,山西农业大学,山西,29.5 "
"348,长春师范大学,吉林,29.4 "
"349,五邑大学,广东,29.4 "
"350,潍坊医学院,山东,29.2 "
"351,成都信息工程大学,四川,29.1 "
"352,湖北汽车工业学院,湖北,29.1 "
"353,吉林农业大学,吉林,29.1 "
"354,山东中医药大学,山东,29.1 "
"355,沈阳理工大学,辽宁,29.1 "
"356,吉林建筑大学,吉林,29.0 "
"357,内蒙古医科大学,内蒙古,29.0 "
"358,山东理工大学,山东,29.0 "
"359,盐城工学院,江苏,29.0 "
"360,滨州医学院,山东,28.9 "
"361,济宁医学院,山东,28.9 "
"362,山西大同大学,山西,28.9 "
"363,沈阳大学,辽宁,28.9 "
"364,西安工程大学,陕西,28.9 "
"365,西华大学,四川,28.9 "
"366,延安大学,陕西,28.9 "
"367,辽宁科技大学,辽宁,28.8 "
"368,辽宁石油化工大学,辽宁,28.8 "
"369,陕西理工大学,陕西,28.8 "
"370,沈阳工程学院,辽宁,28.8 "
"371,玉林师范学院,广西,28.8 "
"372,长沙学院,湖南,28.7 "
"373,湖北理工学院,湖北,28.7 "
"374,山东建筑大学,山东,28.7 "
"375,泰山医学院,山东,28.7 "
"376,天津城建大学,天津,28.7 "
"377,皖南医学院,安徽,28.7 "
"378,徐州工程学院,江苏,28.7 "
"379,湖南商学院,湖南,28.6 "
"380,北京联合大学,北京,28.5 "
"381,北京石油化工学院,北京,28.5 "
"382,东华理工大学,江西,28.5 "
"383,江西科技师范大学,江西,28.5 "
"384,青海大学,青海,28.5 "
"385,河南科技学院,河南,28.4 "
"386,聊城大学,山东,28.3 "
"387,南阳师范学院,河南,28.3 "
"388,贵州医科大学,贵州,28.2 "
"389,金陵科技学院,江苏,28.2 "
"390,龙岩学院,福建,28.2 "
"391,鲁东大学,山东,28.2 "
"392,盐城师范学院,江苏,28.2 "
"393,中原工学院,河南,28.2 "
"394,北京服装学院,北京,28.1 "
"395,肇庆学院,广东,28.1 "
"396,天津农学院,天津,28.0 "
"397,江西农业大学,江西,27.9 "
"398,太原工业学院,山西,27.9 "
"399,云南农业大学,云南,27.9 "
"400,湖南文理学院,湖南,27.8 "
"401,华北水利水电大学,河南,27.8 "
"402,江西理工大学,江西,27.8 "
"403,洛阳师范学院,河南,27.8 "
"404,莆田学院,福建,27.8 "
"405,齐鲁工业大学,山东,27.8 "
"406,青岛农业大学,山东,27.8 "
"407,西南林业大学,云南,27.8 "
"408,宝鸡文理学院,陕西,27.7 "
"409,成都医学院,四川,27.7 "
"410,淮海工学院,江苏,27.7 "
"411,北华大学,吉林,27.6 "
"412,重庆科技学院,重庆,27.6 "
"413,齐齐哈尔大学,黑龙江,27.5 "
"414,许昌学院,河南,27.5 "
"415,上海电机学院,上海,27.4 "
"416,安庆师范大学,安徽,27.3 "
"417,赣南医学院,江西,27.3 "
"418,惠州学院,广东,27.3 "
"419,丽水学院,浙江,27.3 "
"420,佛山科学技术学院,广东,27.2 "
"421,淮阴工学院,江苏,27.2 "
"422,曲靖师范学院,云南,27.2 "
"423,泉州师范学院,福建,27.2 "
"424,四川理工学院,四川,27.2 "
"425,忻州师范学院,山西,27.2 "
"426,吉林医药学院,吉林,27.1 "
"427,佳木斯大学,黑龙江,27.1 "
"428,临沂大学,山东,27.1 "
"429,内蒙古工业大学,内蒙古,27.1 "
"430,山东工商学院,山东,27.1 "
"431,新疆大学,新疆,27.1 "
"432,哈尔滨学院,黑龙江,27.0 "
"433,河南工程学院,河南,27.0 "
"434,吉林化工学院,吉林,27.0 "
"435,江苏理工学院,江苏,27.0 "
"436,江西中医药大学,江西,27.0 "
"437,新疆医科大学,新疆,27.0 "
"438,广西科技大学,广西,26.9 "
"439,湖南工程学院,湖南,26.9 "
"440,岭南师范学院,广东,26.9 "
"441,通化师范学院,吉林,26.9 "
"442,贵州师范学院,贵州,26.8 "
"443,衡阳师范学院,湖南,26.8 "
"444,遵义医学院,贵州,26.8 "
"445,长江师范学院,重庆,26.7 "
"446,成都学院,四川,26.7 "
"447,洛阳理工学院,河南,26.7 "
"448,商丘师范学院,河南,26.7 "
"449,湘南学院,湖南,26.7 "
"450,赣南师范大学,江西,26.6 "
"451,甘肃农业大学,甘肃,26.5 "
"452,荆楚理工学院,湖北,26.5 "
"453,景德镇陶瓷大学,江西,26.5 "
"454,韶关学院,广东,26.5 "
"455,韩山师范学院,广东,26.4 "
"456,湖南城市学院,湖南,26.4 "
"457,太原师范学院,山西,26.4 "
"458,咸阳师范学院,陕西,26.4 "
"459,黄山学院,安徽,26.3 "
"460,南昌工程学院,江西,26.3 "
"461,昆明学院,云南,26.2 "
"462,南京晓庄学院,江苏,26.2 "
"463,玉溪师范学院,云南,26.2 "
"464,贵州民族大学,贵州,26.1 "
"465,华北科技学院,河北,26.1 "
"466,渭南师范学院,陕西,26.0 "
"467,鞍山师范学院,辽宁,25.9 "
"468,重庆三峡学院,重庆,25.8 "
"469,井冈山大学,江西,25.7 "
"470,西藏大学,西藏,25.7 "
"471,北方民族大学,宁夏,25.6 "
"472,长春工程学院,吉林,25.5 "
"473,黑龙江八一农垦大学,黑龙江,25.4 "
"474,黄淮学院,河南,25.3 "
"475,牡丹江医学院,黑龙江,25.3 "
"476,安阳工学院,河南,25.2 "
"477,贵州师范大学,贵州,25.1 "
"478,榆林学院,陕西,25.1 "
"479,湖南工学院,湖南,24.9 "
"480,乐山师范学院,四川,24.9 "
"481,周口师范学院,河南,24.9 "
"482,兰州城市学院,甘肃,24.7 "
"483,内江师范学院,四川,24.7 "
"484,嘉应学院,广东,24.6 "
"485,牡丹江师范学院,黑龙江,24.6 "
"486,皖西学院,安徽,24.6 "
"487,内蒙古科技大学,内蒙古,24.5 "
"488,青海师范大学,青海,24.5 "
"489,南阳理工学院,河南,24.4 "
"490,山东交通学院,山东,24.3 "
"491,怀化学院,湖南,24.2 "
"492,安徽科技学院,安徽,24.1 "
"493,滁州学院,安徽,24.1 "
"494,平顶山学院,河南,24.1 "
"495,四川文理学院,四川,24.1 "
"496,泰山学院,山东,24.1 "
"497,浙江万里学院,浙江,24.1 "
"498,滨州学院,山东,24.0 "
"499,天津职业技术师范大学,天津,24.0 "
"500,邵阳学院,湖南,23.9 "

以上是关于5.13 第一次爬虫和测试的主要内容,如果未能解决你的问题,请参考以下文章

5.13随笔

scrapy按顺序启动多个爬虫代码片段(python3)

scrapy主动退出爬虫的代码片段(python3)

需求分析(5.13)

第一次爬虫和测试

5.13js 数组