使用amazons3的示例python脚本。
s3-client的Python项目详细描述
s3客户机—使用s3的示例python脚本
安装
pip install s3-client
授权
使用环境变量执行授权：
- 在
AWS_ACCESS_KEY_ID-指定AWS访问密钥
在 - 在
AWS_SECRET_ACCESS_KEY指定与访问密钥关联的密钥。这实际上是访问密钥的“密码”。在
在
用法：
^{pr2}$示例：
列出存储桶
$ s3-client -e https://s3.amazonaws.com listbuckets Bucket_Name: test-script1 Creation_Date: 2019-03-22 19:40:36.379000+00:00 Bucket_Name: test-script2 Creation_Date: 2019-03-22 19:50:35.706000+00:00
上载文件
$ s3-client -e https://s3.amazonaws.com upload my_bucket -f my_file.csv Uploading file my_file.csv with object name my_file.csv - Elapsed time0.2451 seconds - Upload completed successfully $ s3-client -e https://s3.amazonaws.com upload my_bucket -d mydir/ Uploading file mydir/test2 with object name mydir/test2 - Elapsed time0.1007 seconds - Upload completed successfully Uploading file mydir/test1 with object name mydir/test1 - Elapsed time0.1183 seconds - Upload completed successfully Uploading file mydir/internal/test3 with object name mydir/internal/test3 - Elapsed time0.1277 seconds - Upload completed successfully Uploading file mydir/internal/deep/test4 with object name mydir/internal/deep/test4 - Elapsed time0.1114 seconds - Upload completed successfully Uploading file mydir/internal/deep/test5 with object name mydir/internal/deep/test5 - Elapsed time0.0683 seconds - Upload completed successfullybucket in
对象列表
$ s3-client listobj -h
usage: s3-client listobj [-h][--limit LIMIT][--table][--prefix PREFIX] bucket
positional arguments:
bucket Bucket Name
optional arguments:
-h, --help show this help message and exit
--limit LIMIT, -l LIMIT
Limit the number of objects returned
--table, -t Show output as table
--prefix PREFIX, -p PREFIX
Only objects with specific prefix
$ s3-client -e https://s3.amazonaws.com listobj my_bucket
key: mydir/internal/deep/test4 size: 10 storage_class: STANDARD e_tag: "d41d8cd98f00b204e9800998ecf8427e" last_modified: 2020-08-21 16:40:42.790000+00:00
key: mydir/internal/deep/test5 size: 203 storage_class: STANDARD e_tag: "7c41d8cd98f00b204e9800998ecf8427" last_modified: 2020-08-21 16:40:42.894000+00:00
key: mydir/internal/test3 size: 42 storage_class: STANDARD e_tag: "9acbdfd98f00b204e9100998ecf8423a" last_modified: 2020-08-21 16:40:42.655000+00:00
key: mydir/test1 size: 1031 storage_class: STANDARD e_tag: "8acffca98f00b204e98a0821ecf8447e" last_modified: 2020-08-21 16:40:42.538000+00:00
key: mydir/test2 size: 121 storage_class: STANDARD e_tag: "d3ab64d98f00b20401800998ecf8438b" last_modified: 2020-08-21 16:40:42.429000+00:00
$ s3-client -e https://s3.amazonaws.com listobj my_bucket -t
| key | size | storage_class | e_tag | last_modified ||---------------------------|--------|-----------------|------------------------------------|----------------------------------|| mydir/internal/deep/test4 |10| STANDARD |"d41d8cd98f00b204e9800998ecf8427e"|2020-08-21 16:40:42.790000+00:00 || mydir/internal/deep/test5 |203| STANDARD |"7c41d8cd98f00b204e9800998ecf8427"|2020-08-21 16:40:42.894000+00:00 || mydir/internal/test3 |42| STANDARD |"9acbdfd98f00b204e9100998ecf8423a"|2020-08-21 16:40:42.655000+00:00 || mydir/test1 |1031| STANDARD |"8acffca98f00b204e98a0821ecf8447e"|2020-08-21 16:40:42.538000+00:00 || mydir/test2 |121| STANDARD |"d3ab64d98f00b20401800998ecf8438b"|2020-08-21 16:40:42.429000+00:00 |
下载对象
$ s3-client -e https://s3.amazonaws.com download -h
usage: s3-client download [-h][--localdir LOCALDIR][--overwrite](--file FILENAME | --prefix PREFIX) bucket
positional arguments:
bucket Bucket Name
optional arguments:
-h, --help show this help message and exit
--localdir LOCALDIR, -l LOCALDIR
Local directory to save downloaded file. Default current directory
--overwrite, -o Overwrite local destination file if it exists. Default false
--file FILENAME, -f FILENAME
Download a specific file
--prefix PREFIX, -p PREFIX
Download recursively all files with a prefix.
$ s3-client -e https://s3.amazonaws.com download my_bucket -f mydir/test1
Error: File ./mydir/test1 exist. Remove it from local drive to download.
$ s3-client -e https://s3.amazonaws.com download my_bucket -f mydir/test1 --overwrite
Downloading object mydir/test1 to path ./mydir/test1
- Elapsed time0.0699 seconds
- Download completed successfully
$ s3-client -e https://s3.amazonaws.com download my_bucket -f mydir/test1 -l /tmp/
Downloading object mydir/test1 to path /tmp/mydir/test1
- Elapsed time0.0593 seconds
- Download completed successfully
$ ls /tmp/mydir/test1
/tmp/mydir/test1
标签：
- 项目
标签：
欢迎加入QQ群-->： 979659372
