web抓取到csv项目问题

2024-06-30 16:25:51 发布

您现在位置:Python中文网/ 问答频道 /正文

我正在尝试制作一款应用程序,它能让我的十大最受欢迎的空间相关股票价格一落千丈。但是

  • 我的代码有点问题,我是个新手
  • 一旦我得到这个工作,我想把它放到一个csv文件
  • 并用它做一个条形图,我想得到一些帮助和建议
  • 我也是在水蟒身上做的:

我的代码:

from bs4 import BeautifulSoup 
#grequests is a unique library that allows you to use many urls with ease
#must install qrequest in annacode use : conda install -c conda-forge grequests
#if you know a better way to do this, please let me know
import grequests

#scraping my top ten favorite space companies, attempted to pick companies with pure play interest in space


urls = ['https://finance.yahoo.com/quote/GILT/', 'https://finance.yahoo.com/quote/LORL?p=LORL&.tsrc=fin-srch', 'https://finance.yahoo.com/quote/I?p=I&.tsrc=fin-srch' , 'https://finance.yahoo.com/quote/VSAT?p=VSAT&.tsrc=fin-srch', 'https://finance.yahoo.com/quote/RTN?p=RTN&.tsrc=fin-srch', 'https://finance.yahoo.com/quote/UTX?ltr=1', 'https://finance.yahoo.com/quote/TDY?ltr=1', 'https://finance.yahoo.com/quote/ORBC?ltr=1', 'https://finance.yahoo.com/quote/SPCE?p=SPCE&.tsrc=fin-srch', 'https://finance.yahoo.com/quote/BA?p=BA&.tsrc=fin-srch',]  
unsent_request = (grequests.get(url) for url in urls)

results = grequests.map(unsent_request)


def  parsePrice():
    soup = BeautifulSoup(r.text,"html")
    price=soup.find_all('div',{'class':'Trsdu(0.3s) Fw(b) Fz(36px) Mb(-4px) D(ib)" data-reactid="52">4.1500'})[0].find('span').text
    return price

    #Trying to figure out how to add this 
    # Random delay
    duration = random.uniform(1, 4)
    print('Random delay for %.2f seconds' % duration)
    time.sleep(duration)

    print('Scraping website for', urls)
    urls = hrefs[stock]
    soup = BeautifulSoup(page.text, 'html.parser')

在这之后,我得到了这个错误:

File "<ipython-input-17-834b9d6c20e5>", line 3
    duration = random.uniform(1, 4)
    ^
IndentationError: unexpected indent

while True:
    print('current stock price: '+str(parsePrice()))

#add to csv file 
df_indu = pd.DataFrame(
    L['Top Ten Space Stocks'],
    columns=['stock name', 'stock price', 'date of listing'])
df_indu.to_csv('spacestocks.csv', index=False, sep='|')

这是我到目前为止的全部计划。我试图添加一个时间延迟和刮所有这些股票的股票价格放在一个csv文件图形。。。谢谢


Tags: csvtohttpscomstockurlspriceyahoo
1条回答
网友
1楼 · 发布于 2024-06-30 16:25:51

代码在parsePrice()函数定义处缩进。在函数结束时,声明return price,从而结束函数定义。现在,下面的代码不应该再缩进了。这就是为什么在那之后所有的东西都会出现意外的缩进错误

相关问题 更多 >