下载一个CSV文件,然后使用Python上传到MySQL

2024-10-01 05:04:10 发布

您现在位置:Python中文网/ 问答频道 /正文

我尝试构建一个简单的python脚本来收集“实时”地震数据 来自美国地质勘探局网站,该网站以CSV文件形式提供。我的愿望是抓住 使用python的数据,并更新MySQL服务器 建造。在

C:\Python27\python.exe C:/Users/XXXX/PycharmProjects/QuakeUpload/TestSQLOpen2.py
Traceback (most recent call last):
  File "C:/Users/XXXX/PycharmProjects/QuakeUpload/TestSQLOpen2.py", line 19, in <module>
    with connection.cursor() as cursor:
  File "C:\Python27\lib\site-packages\pymysql\connections.py", line 745, in cursor
    return self.cursorclass(self)
TypeError: 'str' object is not callable

Process finished with exit code 1

^{pr2}$

Tags: 数据inpyself网站withlineusers
2条回答

有趣的是,回溯错误消息没有显示导致错误的行。导致错误的行出现在调用connection.cursor()之前(回溯的目标行是问题的根源)。在

错误是由

connection = pymysql.connect(host='b8con.no-ip.org', user='sal', 
                 password='bigsal71', db='EarthQuake', charset='utf8mb4', 
                 cursorclass="pymysql.cursors.DictCursor")

可以通过 removing the double quotes from around the cursorclass

^{pr2}$

注意,pymysql.cursors.DictCursor是一个 当"pymysql.cursors.DictCursor"是字符串时初始化。如果self.cursorclass是 设置为pymysql.cursors.DictCursor(通过cursorclass参数),然后

return self.cursorclass(self)

返回DictCursor类的实例。如果self.cursorclass是字符串"pymysql.cursors.DictCursor",则调用该字符串将引发

TypeError: 'str' object is not callable

因为字符串是不可调用的。在


同样,作为nightuser points out

for line in csvfile():

应该是

for line in csvfile:

(不带括号)因为csvfile本身就是iterable。在

谢谢各位!我能让它发挥作用。下面是我的最终代码。在

import pymysql
import codecs
import csv
import urllib2
import pymysql.cursors

# Get URL Data
url = "http://earthquake.usgs.gov/earthquakes/feed/v1.0/summary/all_month.csv"
URLstream = urllib2.urlopen(url)
csvfile = csv.reader(codecs.iterdecode(URLstream, 'utf-8'))

# Connect to the database

connection = pymysql.connect(host='b8con.no-ip.org', user='HanSolo', password='password', db='EarthQuake', charset='utf8mb4', cursorclass=pymysql.cursors.DictCursor)

try:
    with connection.cursor() as cursor:
        sql = "INSERT INTO quakedata(time, latitude, longitude, depth, mag, magType, nst, gap, dmin, rms, net, id, updated, place, type) VALUES(%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s)"
        next(csvfile, None)
        for line in csvfile:
            cursor.execute(sql, (line[0], line[1], line[2], line[3], line[4], line[5], line[6], line[7], line[8], line[9], line[10], line[11], line[12], line[13], line[14]))

finally:
    connection.commit()
    connection.close()

相关问题 更多 >