栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 软件开发 > 后端开发 > Python

python爬虫案例(3)

Python 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

python爬虫案例(3)

前言 python爬取某站表情包,用到的包有requests、BeautifulSoup、time、os
1.代码如下:
import requests
from bs4 import BeautifulSoup
import time
import os

url = 'https://www.fabiaoqing.com/'
res = requests.get(url)
res_html = res.content.decode()
soup = BeautifulSoup(res_html, 'html.parser')
# print(soup)

if not os.path.exists('./表情包/'):
    os.mkdir('./表情包/')

picture_jpg = []
picture_gif = []
name_jpg = []
name_gif = []

picture = soup.find('div', class_='ui segment imghover bqba indexbiaoqing').find_all('div', class_='bqppdiv')
# print(picture, 'n', len(picture))
name = soup.find('div', class_='ui segment imghover bqba indexbiaoqing').find_all('div', class_='bqppdiv')
# print(name, 'n', len(name))
for pic, na in zip(picture, name):
    na = na.a.get('title')
    # print(na, 'n', type(na))
    pic = pic.a.img.get('data-original')
    # print(pic, 'n', type(pic))
    pic_id = pic[::-1][:3]
    # print(pic_id, 'n', type(pic_id))
    if pic_id == 'gpj':
        # print(pic, 'n', type(pic))
        # picture_jpg.append(pic)
        # name_jpg.append(na)
        picture_jpg_html = requests.get(url=pic).content
        with open('./表情包/' + na + '.jpg', 'wb') as f:
            f.write(picture_jpg_html)
            print(na + "下载成功!")
            time.sleep(1)
    else:
        # picture_gif.append(pic)
        # name_gif.append(na)
        picture_gif_html = requests.get(url=pic).content
        with open('./表情包/' + na + '.gif', 'wb') as f:
            f.write(picture_gif_html)
            print(na + "下载成功!", 'n', '*'*50)
            time.sleep(1)
print('*'*100, 'n', '所有表情包下载完毕!')
# print(picture_jpg, 'n', len(picture_jpg))
# print(picture_gif, 'n', len(picture_gif))
# print(name_jpg, 'n', len(name_jpg))
# print(name_gif, 'n', len(name_gif))

2.结果展示 总结

这儿需要注意一下有的表情包是jpg或者gif格式,所以保存文件的时候需要区分文件的后缀名。

暑期编程PK赛 得CSDN机械键盘等精美礼品!
转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/1015723.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号