如何在LinkedIn上循环浏览所有页面，同时抓取数百个页面？

Question

我想在LinkedIn上获取特定角色的数据。但是，我不知道如何遍历所有的搜索结果来提取信息。搜索结果的数量约为4191个（约180-200页）。代码如下：

计数=1 计数时<；4192：

id_text = raw.find('code', {'id':'decoratedJobPostingsModule'})
data = []

for d in id_text:
    data.append(json.loads(d))

for num in range(0, len(data[0]['elements'])):

    job_site_link = data[0]['elements'][num]['companyTextUrl']
    company_name = data[0]['elements'][num]['decoratedJobPosting']['companyName']
    job_title = data[0]['elements'][num]['decoratedJobPosting']['jobPosting']['title']
    city = data[0]['elements'][num]['decoratedJobPosting']['formattedLocation']+" ("+data[0]['elements'][num]['decoratedJobPosting']['cityState']+")"

    result= result.append({'Job site Link':job_site_link, 'Company name':company_name, 'Job title':job_title, 'Company City':city,}, ignore_index=True)


count=count+1