TrueCloudLab/rclone
16
0
Fork 4
Code Issues 3 Pull requests 2 Projects Releases 2 Packages Wiki Activity Actions
rclone/backend
History
Nick Craig-Wood 3f53283ebf s3: fix Wasabi HEAD requests returning stale data by using only 1 transport 
In this commit

fc5b14b620 s3: Added `--s3-disable-http2` to disable http/2

We created our own transport so we could disable http/2. However the
added function is called twice meaning that we create two HTTP
transports. This didn't happen with the original code because the
default transport is cached by fshttp.

Rclone normally does a PUT followed by a HEAD request to check an
upload has been successful.

With the two transports, the PUT and the HEAD were being done on
different HTTP transports. This means that it wasn't re-using the same
HTTP connection, so the HEAD request showed the previous object value.
This caused rclone to declare the upload was corrupted, delete the
object and try again.

This patch makes sure we only create one transport and use it for both
PUT and HEAD requests which fixes the problem with Wasabi.

See: https://forum.rclone.org/t/each-time-rclone-is-run-1-3-fails-2-3-succeeds/22545
2021-03-05 15:35:23 +00:00
..
alias alias: fix tests after parsing of ... change #4862 2020-12-21 18:23:16 +00:00
all HDFS (Hadoop Distributed File System) implementation - #42 2021-01-07 09:48:51 +00:00
amazonclouddrive fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
azureblob azureblob: require go1.14+ to compile due to SDK changes 2021-01-30 18:01:12 +00:00
b2 b2: fix failed to create file system with application key limited to a prefix 2021-02-10 15:27:45 +00:00
box box: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
cache fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
chunker chunker: fix case-insensitive NewObject, test metadata detection #4902 2021-01-10 22:29:24 +03:00
compress compress: check type assertion in SetTier - fixes #4941 2021-01-20 22:59:14 +00:00
crypt fs: add Shutdown optional method for backends 2020-11-27 17:35:01 +00:00
drive drive: refer to Shared Drives instead of Team Drives 2021-02-10 15:27:19 +00:00
dropbox dropbox: add scopes to oauth request and optionally "members.read" 2021-02-13 12:35:45 +00:00
fichier fichier: set Features.ReadMimeType=true as Object.MimeType is supported 2020-11-29 17:22:43 +00:00
filefabric filefabric: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
ftp ftp,sftp: Make --tpslimit apply - fixes #4906 2021-01-08 10:29:57 +00:00
googlecloudstorage gcs: Fix Entry doesn't belong in directory "" (same as directory) - ignoring 2021-01-19 16:50:37 +00:00
googlephotos gphotos: new flag --gphotos-include-archived - fixes #4728 2021-01-28 16:51:31 +00:00
hdfs hdfs: support kerberos authentication #42 2021-01-27 18:16:58 +00:00
http fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
hubic fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
jottacloud jottacloud: Add support for Telia Cloud (#4930) 2021-01-17 02:38:57 +01:00
koofr fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
local local: new flag --local-zero-size-links to fix sync on some virtual filesystems 2021-01-27 18:13:16 +00:00
mailru fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
mega fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
memory azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
onedrive onedrive: add support for china region operated by 21vianet #4963 (#4963) 2021-01-29 23:04:21 +03:00
opendrive opendrive: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
pcloud azureblob,memory,pcloud: fix setting of mime types 2020-11-27 14:40:05 +00:00
premiumizeme premiumizeme: fix finding directories in a case insensitive way #4830 2021-01-27 14:28:17 +00:00
putio fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
qingstor qingstor: fix rclone cleanup 2021-01-21 17:35:31 +00:00
s3 s3: fix Wasabi HEAD requests returning stale data by using only 1 transport 2021-03-05 15:35:23 +00:00
seafile fshttp: read config from ctx not passed in ConfigInfo #4685 2020-11-26 16:40:12 +00:00
sftp sftp: implement --sftp-use-fstat 2021-01-28 16:07:26 +00:00
sharefile fs: deglobalise the config #4685 2020-11-26 16:40:12 +00:00
sugarsync sugarsync: fix finding directories in a case insentive way #4830 2021-01-26 14:48:33 +00:00
swift swift: ensure partially uploaded large files are uploaded unless --swift-leave-parts-on-error 2021-01-28 17:09:41 +00:00
tardigrade config: add context.Context #3257 #4685 2020-11-09 18:05:54 +00:00
union union: fix mkdir at root with remote:/ 2021-02-17 12:12:14 +00:00
webdav webdav: add "Depth: 0" to GET requests to fix bitrix 2020-12-30 10:14:50 +00:00
yandex yandex: set Features.WriteMimeType=false as Yandex ignores mime types 2020-11-29 17:22:43 +00:00
zoho zoho: fix custom client id's 2021-02-23 11:27:19 +00:00