📜  抓取站点地图 - 任何代码示例

📅  最后修改于: 2022-03-11 15:00:01.333000             🧑  作者: Mango

代码示例1
import requests
from urllib.parse import urlencode

list_of_urls = ['http://quotes.toscrape.com/page/1/', 'http://quotes.toscrape.com/page/2/']

for url in list_of_urls: 
    params = {'api_key': API_KEY, 'url': url}
    response = requests.get('http://api.scraperapi.com/', params=urlencode(params))
    print(response.text)