TrueCloudLab/rclone
16
0
Fork 2
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions 1
rclone/backend
History
Nick Craig-Wood cb16f42075 b2: Make NewObject use less expensive API calls 
Before this change when NewObject was called the b2 backend would list
the directory that the object was in in order to find it.

Unfortunately list calls are Class C transactions and cost more.

This patch switches to using HEAD requests instead. These are Class B
transactions. It is then necessary to parse the headers from response
back into the data that we get from the listing. However B2 returns
exactly the same data, just in a different form.

Rclone will use the old directory listing method when looking for
files with versions as these can't be found via a HEAD request.

This change will particularly benefit --files-from, rclone serve
restic but most operations will see some benefit.
2020-12-09 20:00:22 +00:00
..
alias accounting: add context.Context #3257 #4685 2020-11-09 18:05:54 +00:00
all filefabric: Implement the Enterprise File Fabric backend 2020-11-25 21:11:29 +00:00
amazonclouddrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
azureblob azure: add support for service principals - fixes #3230 2020-12-09 17:52:15 +00:00
b2 b2: Make NewObject use less expensive API calls 2020-12-09 20:00:22 +00:00
box box: fix NewObject for files that differ in case #4830 2020-12-07 17:38:22 +00:00
cache fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
chunker chunker: set Features.ReadMimeType=false as Object.MimeType not supported 2020-11-29 17:22:43 +00:00
compress compress: fix broken tests 2020-12-02 16:30:02 +01:00
crypt fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
drive drive: allow shortcut resolution and creation to be retried 2020-12-02 15:28:38 +00:00
dropbox dropbox: enable short lived access tokens #4792 2020-12-02 16:50:16 +00:00
fichier fichier: set Features.ReadMimeType=true as Object.MimeType is supported 2020-11-29 17:22:43 +00:00
filefabric filefabric: set Features.Read/WriteMimeType as both supported 2020-11-29 17:22:43 +00:00
ftp fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
googlecloudstorage gcs: fix server side copy of large objects - fixes #3724 2020-11-30 16:20:30 +00:00
googlephotos fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
http fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
hubic fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
jottacloud jottacloud: don't erroniously report support for writing mime types - fixes #4817 2020-11-29 18:11:43 +01:00
koofr fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
local local: continue listing files/folders when a circular symlink is detected 2020-11-12 11:32:55 +00:00
mailru fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
mega fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
memory azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
onedrive fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
opendrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
pcloud azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
premiumizeme fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
putio fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
qingstor fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
s3 s3: Added error handling for error code 429 indicating too many requests 2020-12-01 18:13:31 +00:00
seafile fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
sftp sftp: implement Shutdown method 2020-11-27 17:35:01 +00:00
sharefile fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
sugarsync sugarsync: fix NewObject for files that differ in case #4830 2020-12-07 17:38:22 +00:00
swift fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
tardigrade config: add context.Context #3257 #4685 2020-11-09 18:05:54 +00:00
union fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
webdav fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
yandex yandex: set Features.WriteMimeType=false as Yandex ignores mime types 2020-11-29 17:22:43 +00:00