Python Boto3 AWS多部分上传语法

2024-10-01 09:38:18 发布

您现在位置:Python中文网/ 问答频道 /正文

我成功地使用AWS进行了身份验证,并在Bucket对象上使用了“put_object”方法来上载文件。现在,我想使用multipart API来实现对大文件的这一点。我在这个问题上找到了公认的答案: How to save S3 object to a file using boto3

但在尝试实现时,我遇到了“未知方法”错误。我做错什么了?我的代码在下面。谢谢!在

## Get an AWS Session
self.awsSession = Session(aws_access_key_id=accessKey,
aws_secret_access_key=secretKey,
aws_session_token=session_token,
region_name=region_type)  

 ...          

# Upload the file to S3
s3 = self.awsSession.resource('s3')
s3.Bucket('prodbucket').put_object(Key=fileToUpload, Body=data) # WORKS
#s3.Bucket('prodbucket').upload_file(dataFileName, 'prodbucket', fileToUpload) # DOESNT WORK
#s3.upload_file(dataFileName, 'prodbucket', fileToUpload) # DOESNT WORK

Tags: 文件to方法selfawsobjects3bucket
2条回答

upload_file方法尚未移植到bucket资源。现在,您需要直接使用client对象来执行此操作:

client = self.awsSession.client('s3')
client.upload_file(...)

Libcloud S3 wrapper透明地为您处理所有部件的拆分和上载。在

使用upload_object_via_stream方法执行此操作:

from libcloud.storage.types import Provider
from libcloud.storage.providers import get_driver

# Path to a very large file you want to upload
FILE_PATH = '/home/user/myfile.tar.gz'

cls = get_driver(Provider.S3)
driver = cls('api key', 'api secret key')

container = driver.get_container(container_name='my-backups-12345')

# This method blocks until all the parts have been uploaded.
extra = {'content_type': 'application/octet-stream'}

with open(FILE_PATH, 'rb') as iterator:
    obj = driver.upload_object_via_stream(iterator=iterator,
                                          container=container,
                                          object_name='backup.tar.gz',
                                          extra=extra)

有关S3多部分特性的官方文档,请参阅AWS Official Blog。在

相关问题 更多 >