随机创建一个UserAgent,避免大量爬取时服务器拒绝
from fake_UserAgent import random_UserAgent
response = requests.get(url=url, headers=random_UserAgent())
response = requests.get(url=url, headers=random_UserAgent(edge=True))
直接返回一个字典
{'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Safari/537.36'}
{'User-Agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.60 Safari/537.36 Edg/103.0.1264.49'}
如果请求出现错误,请自行修改第64行的 'User-Agent': f'{user_agent}' 为 'user-agent': f'{user_agent}' 后,再做尝试
63 header = {
64 'User-Agent': f'{user_agent}'
65 }