python3爬取qq音乐并下载

Posted 2021-01-23 szj22233060

本文参考Python 爬取qqmusic音乐url并批量下载

同学找我爬取一下qq音乐播放链接，包括歌词等信息打包成json，试了一下可以爬取。

一、找到qq音乐播放的url

1.找到搜索页面返回的数据包

歌曲最终的播放链接时经过多次拼接的，首先找到qq音乐搜索歌曲界面，https://y.qq.com/portal/search.html#page=1&searchid=1&remoteplace=txt.yqq.top&t=song&w=%E5%91%A8%E6%9D%B0%E4%BC%A6

右键-检查-刷新-点击Network,ctrl+f，在控制台右面搜索第一首歌就会出现这个界面返回的json包

这个请求的链接是：

url1：https://c.y.qq.com/soso/fcgi-bin/client_search_cp?ct=24&qqmusic_ver=1298&new_json=1&remoteplace=txt.yqq.song&searchid=64791389917821519&t=0&aggr=1&cr=1&catZhida=1&lossless=0&flag_qc=0&p=1&n=20&w=%E5%91%A8%E6%9D%B0%E4%BC%A6&g_tk=5381&jsonpCallback=MusicJsonCallback4053122785448291&loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0

这个链接中有两个关键字，n和w，分别是请求返回的歌曲条数和请求的歌曲名或歌手名，这是第一个链接。（w是unicode字符，我感觉直接中文也可以）

2.获得返回的数据包后开始解析

url1返回的数据包把头部 MusicJsonCallback4053122785448291 去掉后如下格式：

从返回的数据包中提取mid和strMediaMid,然后组合到第二个url中

url2：

‘https://c.y.qq.com/base/fcgi-bin/fcg_music_express_mobile3.fcg?&jsonpCallback=MusicJsonCallback&cid=205361747&songmid=‘ + mid + ‘&filename=C400‘ + strMediaMid + ‘.m4a&guid=6612300644‘

 这个链接如果在浏览器打开会下载一个文件 fcg_music_express_mobile3.fcg 打开之后可以看到vkey：

{"code":0,"cid":205361747,"userip":"183.197.0.92","data":{"expiration":80400,"items":[{"subcode":0,"songmid":"002eTq6539AsfN","filename":"C400001GuWCx14Gng9.m4a","vkey":"1F051B9378DC2CD04C0B6D2257E40D0F03E6FA042D076E462FEFF6534EFA4B579A47F084811B4BE893006805A9439224D286200FDE1598D0"}]}}

3.将url2获取的 vkey 和 strMediaMids 一起组合成最终的url

url3:  http://dl.stream.qqmusic.qq.com/C400‘ + strMediaMids[n] + ‘.m4a?vkey=‘ + vkey + ‘&guid=6612300644&uin=0&fromtag=66

 最终url（可以打开）：http://dl.stream.qqmusic.qq.com/C400001GuWCx14Gng9.m4a?vkey=1F051B9378DC2CD04C0B6D2257E40D0F03E6FA042D076E462FEFF6534EFA4B579A47F084811B4BE893006805A9439224D286200FDE1598D0&guid=6612300644&uin=0&fromtag=66

二、下载歌曲

有了url下载就很简单了，用urllib.request.urlretrieve()下载。

urllib.request.urlretrieve(url, ‘F:music\\‘+data[key][‘歌名‘]+‘.m4a‘)

 源码

源码中加入了保存json文件，方便调用读取。

  1 import json
  2 import requests
  3 import re
  4 import urllib
  5 import time
  6 
  7 def parse(keyword,num):
  8     #keyword:要搜索的歌名或者歌手名,num:搜索结果的条数
  9     url = ‘https://c.y.qq.com/soso/fcgi-bin/client_search_cp?ct=24&qqmusic_ver=1298&new_json=1&remoteplace=txt.yqq.song‘  10           ‘&searchid=57124856116396257&t=0&aggr=1&cr=1&catZhida=1&lossless=0&flag_qc=0&p=1&‘  11           ‘n=‘+str(num)+‘&w=‘+str(keyword)+‘&g_tk=5381&jsonpCallback=MusicJsonCallback3695372008103126‘  12           ‘&loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0‘
 13     print(url)
 14     #添加user-agent
 15     head = {‘user-agent‘:‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36‘}
 16 
 17     #第一次返回：MusicJsonCallback3695372008103126包
 18     response = requests.get(url, headers=head)
 19     response = response.text.strip("MusicJsonCallback3695372008103126()[]")
 20 
 21     #解析json
 22     json_data = json.loads(response)
 23     print(json_data)
 24 
 25     json_data = json_data[‘data‘][‘song‘][‘list‘]
 26     print(json_data)
 27     strMediaMids = []
 28     songmids = []
 29     srcs = {}
 30     songnames = []
 31     singers = []
 32     albumns = []
 33     songid = []
 34     #遍历所获取的列表，找到歌曲信息存储在list中
 35     for data in json_data:
 36         try:
 37             strMediaMids.append(data[‘file‘][‘strMediaMid‘])
 38             songmids.append(data[‘mid‘])
 39             songnames.append(data[‘name‘])
 40             singers.append(data[‘singer‘][0][‘name‘])
 41             albumns.append(data[‘album‘][‘name‘])
 42             songid.append(data[‘id‘])
 43         except:
 44             print(‘wrong‘)
 45 
 46     #将获取到的信息二次组装成url
 47     for n in range(0,len(strMediaMids)):
 48 
 49         #将strMediaMids和songmids重新组合到url中
 50         url2 = ‘https://c.y.qq.com/base/fcgi-bin/fcg_music_express_mobile3.fcg?&jsonpCallback=MusicJsonCallback&cid=205361747&songmid=‘ + songmids[n] + ‘&filename=C400‘ + strMediaMids[n] + ‘.m4a&guid=6612300644‘
 51         #获取返回文件并解析得到vkey
 52         response2 = requests.get(url2)
 53         json_data2 = json.loads(response2.text)
 54         vkey = json_data2[‘data‘][‘items‘][0][‘vkey‘]
 55         #这是最终的歌曲url
 56         song_url = ‘http://dl.stream.qqmusic.qq.com/C400‘ + strMediaMids[n] + ‘.m4a?vkey=‘ + vkey + ‘&guid=6612300644&uin=0&fromtag=66‘
 57 
 58         # 获取歌词文本
 59         refer = ‘https://y.qq.com/n/yqq/song/‘ + songmids[n] + ‘.html‘
 60         head = {
 61             ‘user-agent‘: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36‘,
 62             ‘Referer‘: refer}
 63         lyric_url = ‘https://c.y.qq.com/lyric/fcgi-bin/fcg_query_lyric.fcg?nobase64=1&musicid=‘  64                     + str(songid[n]) + ‘&callback=jsonp1&g_tk=5381&jsonpCallback=jsonp1&loginUin=0&hostUin=0&format=jsonp&inCharset=utf8&outCharset=utf-8&notice=0&platform=yqq&needNewCode=0‘
 65         response3 = requests.get(lyric_url, headers=head).text
 66         json_data3 = response3.strip(‘ jsonp1()[]‘)
 67         print(json_data3)
 68         jsonp1 = json.loads(json_data3)
 69         try:
 70             lyric = jsonp1[‘lyric‘]
 71         except:
 72             print(‘wrong‘)
 73         # print(lyric)
 74 
 75         # result = re.findall(r‘[u4e00-u9fa5]+‘, lyric)
 76         # lyric = ‘ ‘.join(result)
 77         data = {}
 78         data[‘歌手‘] = singers[n]
 79         data[‘歌名‘] = songnames[n]
 80         data[‘专辑‘] = albumns[n]
 81         data[‘url‘] = song_url
 82         data[‘lyric‘] = lyric
 83         data[‘songmid‘] = songmids[n]
 84         data[‘strMediaMids‘] = strMediaMids[n]
 85         data[‘songid‘] = songid[n]
 86         srcs[n] = data
 87     with open(str(keyword)+‘.json‘, ‘w‘,encoding=‘utf-8‘) as f:
 88         json.dump(srcs, f)
 89 
 90 
 91 
 92 def download(keyword):
 93     with open(keyword+‘.json‘,‘r‘) as f:
 94         data = json.load(f)
 95     # print(data)
 96     for key in data:
 97         time.sleep(1)
 98         url = data[key][‘url‘]
 99         # print(url)
100         print(‘正在下载:‘,data[key][‘歌名‘],‘......‘)
101         try:
102             urllib.request.urlretrieve(url, ‘F:music\\‘+data[key][‘歌名‘]+‘.m4a‘)
103             # with open(str(data[key][‘歌名‘])+‘-‘+str(data[key][‘歌手‘])+‘.m4a‘,‘w‘) as f:
104             #     f.write(requests.get(url).content)
105         except:
106             print(‘下载‘+data[key][‘歌名‘]+‘失败‘)
107     print(‘下载完成！‘)
108 
109 
110 keyword = ‘周杰伦‘
111 num = 1
112 parse(keyword, num)
113 download(keyword)

 

 有错误欢迎指正！