擅长:python、mysql、java
<p>您还没有表现出自己努力达成解决方案的努力,但是您可以这样做:</p>
<pre><code>offset = 0
pg = 1
base_url = 'https://url?start={0}&pg={1}'
url = base_url.format(offset,pg)
results = first page from BeautifulSoup scrape or requests.get
all_results= results
while results:
# Rebuild url base on current start.
start += rows
url = base_url.format(offset, pg)
results = next page from BeautifulSoup scrape or requests.get
all_results += results
</code></pre>