抓取网易云歌单的数据

import requests
import time
from bs4 import BeautifulSoup

headers={
   "user-agent":"Mozilla/5.0(Windows NT 10.0；WOW64)AppleWebKit/537.36(KHTML, likeGecko) Chrome / 75.0.3770.100Safari / 537.36"
}

for i in range(0,140,35):
    url = 'https://music.163.com/discover/playlist/?order=hot&cat=华语&limit=35&offset=3' + str(i)
    html = response.text
    soup = BeautifulSoup(html,'html.parser')

    ids = soup.select('.dec a')
    lis = soup.select('#m-pl-container li')
    print(len(lis))
    for j in range(len(lis)):
        url = ids[j]['href']
        list_id = url.split('?')[1]
        title = ids[j]['title'].replace(',',',')
        play = lis[j].select('.nb')[0].get_text()
        source = lis[j].select('p')[1].select('a')[0].get_text()
        print(list_id, title, play, source)
        with open('list.scv', 'a+', encoding='utf-8') as f:
           f.write(list_id + '.' + title + '.' + play + '.' +source + 'n')
     time.sleep(2)

利用python爬虫网易云

对网易云音乐中 歌单的数据抓取，包括歌单的名称、歌单id、歌单的播放量、歌单来源

网易云还是有一些反爬措施的

Eg.:https://music.163.com/#/discover/playlist/?order=hot&cat=华语&limit=35&offset=35

#是加密处理

--python course