我的csv文件在每个字母后面都只有逗号。它将数据写入换行符。我怎么把数据弄错了?我试着把每个地址写到一个新的csv行后,把它放入一个列表。我尝试过各种不同的方法来将数据写入csv文件,但是没有任何效果。我不知道该怎么做才能让数据写上名字而不是这么多逗号。在
import requests
from bs4 import BeautifulSoup
import csv
search_terms = "Bars"
location = "New Orleans, LA"
all_data = []
if ' ' in search_terms:
search_terms = search_terms.replace(' ', '+')
print(search_terms)
if ', ' in location:
location = location.replace(', ', '+')
print(location)
count = 1
while True:
page_number = str(count)
url = "https://www.yellowpages.com/search? search_terms="+search_terms+"&geo_location_terms="+location+"&page="+page_number
print(url)
page = requests.get(url)
soup = BeautifulSoup(page.text, 'html.parser')
info = soup.findAll("div", {"class": "info"})
if soup.findAll("div", {"class": "info"}):
count = count+1
for each in info:
try:
business_name = each.find(itemprop="name").get_text()
except:
business_name = "No Business Name"
try:
street = each.find(itemprop="streetAddress").get_text()
except:
street = "No Street Address"
try:
city = each.find(itemprop="addressLocality").get_text()
except:
city = "No City,"
try:
state = each.find(itemprop="addressRegion").get_text()
except:
state = "No State"
try:
zip = each.find(itemprop="postalCode").get_text()
except:
zip = "No Zip Code"
try:
telephone = each.find(itemprop="telephone").get_text()
except:
telephone = "No Telephone"
business_data = business_name+","+street+","+city+state+","+zip+","+telephone
business_data = business_data.replace(u'\xa0', u'')
all_data.append(business_data)
else:
break
with open(search_terms+'.csv', 'w+') as wf:
csv_writer = csv.writer(wf)
csv_writer.writerow(["Business Name","Street Address", "City", "State", "Zip", "Telephone"])
for line in all_data:
csv_writer.writerow(line)
print(line)
writerow方法需要一个由行的所有项组成的iterable。当您向它传递一个字符串时,它将遍历每个字符并将每个字符视为一个项。在
而是去田野里,而不是
你可能想试试
^{pr2}$all_data.append(business_data)
将一个字符串附加到所有的\u数据, 因此,csv_writer.writerow(line)
将line
作为字符串,而它期望list
。 尝试:相关问题 更多 >
编程相关推荐