Nathan Collins
be19d6a403
fshttp: prevent overlap of HTTP headers in logs
2020-12-27 12:44:46 +00:00
Nick Craig-Wood
9d574c0d63
fshttp: read config from ctx not passed in ConfigInfo #4685
2020-11-26 16:40:12 +00:00
Nick Craig-Wood
2e21c58e6a
fs: deglobalise the config #4685
...
This is done by making fs.Config private and attaching it to the
context instead.
The Config should be obtained with fs.GetConfig and fs.AddConfig
should be used to get a new mutable config that can be changed.
2020-11-26 16:40:12 +00:00
Nick Craig-Wood
b5c654a100
lib/structs: factor reflection based structure manipulation into a library
2020-06-10 12:28:48 +01:00
Martin Michlmayr
4aee962233
doc: fix typos throughout docs and code
2020-05-20 15:54:51 +01:00
Nick Craig-Wood
f6346a4d29
fs: add --header flag to add options to every HTTP transaction #59
2020-04-23 15:24:21 +01:00
Xiaoxing Ye
0ab2693da6
doc: add desc about gzip and http dump
...
Fix #3872
2020-01-23 12:42:44 +00:00
Nick Craig-Wood
277d94feac
fshttp: add --expect-continue-timeout default 1s - fixes #3835
...
Before this change the expect/continue timeout was set to
--conntimeout which was 60s by default which is too long to wait.
This was noticed when using s3 with a proxy which apparently didn't
support expect / continue properly.
Set --expect-continue-timeout 0 to disable expect/continue.
2020-01-18 09:49:22 +00:00
Nick Craig-Wood
e6378daadf
fshttp: don't print token bucket errors on context cancelled
...
These happen as a natural part of exceeding --max-transfer and we
don't need to worry the user with them.
2019-10-30 12:20:10 +00:00
Nick Craig-Wood
e81eca4055
fshttp: fix error reporting on tpslimit token bucket errors
2019-10-28 22:11:38 +00:00
Nick Craig-Wood
0b6cdb7677
fshttp: allow Transport to be customized #3631
2019-10-16 11:26:08 +01:00
Nick Craig-Wood
57d5de6fba
build: fix up package paths after repo move
...
git grep -l github.com/ncw/rclone | xargs -d'\n' perl -i~ -lpe 's|github.com/ncw/rclone|github.com/rclone/rclone|g'
goimports -w `find . -name \*.go`
2019-07-28 18:47:38 +01:00
Stefan Breunig
72721f4c8d
copyurl: honor --no-check-certificate
2019-05-11 17:44:58 +01:00
Fabian Möller
48c09608ea
fix spelling
2019-04-30 14:12:18 +02:00
Nick Craig-Wood
b167d30420
Add client side TLS/SSL flags --ca-cert/--client-cert/--client-key
...
Fixes #2966
2019-02-12 12:26:19 +00:00
qip
f471a7e3f5
fshttp: Add cookie support with cmdline switch --use-cookies
...
Cookies are handled by cookiejar in memory with fshttp module through
the entire session.
One useful scenario is, with HTTP storage system where index server
adds authentication cookie while redirecting to CDN for actual files.
Also, it can be helpful to reuse fshttp in other storage systems
requiring cookie.
2019-01-11 17:35:29 +00:00
Oleg Kovalov
06c9f76cd2
all: fix go-critic linter suggestions
2018-08-06 21:14:03 +01:00
Nick Craig-Wood
e80ae4e09c
build: remove unused struct fields spotted by structcheck
2018-05-05 17:32:41 +01:00
Nick Craig-Wood
37be78705d
fs/fshttp: limit MaxIdleConns and MaxIdleConnsPerHost
...
Before this change mega (which uses a different host per download)
would open too many sockets.
2018-04-11 20:51:28 +01:00
Nick Craig-Wood
be54fd8f70
Remove builds conditional on go1.7 since that is now guaranteed #2154
...
Old fallback code was deleted and the go1.7 style code inlined where
appropriate.
2018-04-07 11:42:55 +01:00
Nick Craig-Wood
80588a5a6b
Replace "golang.org/x/net/context" with "context" for go1.7+ #2154
2018-04-07 11:42:08 +01:00
Nick Craig-Wood
67023f0040
Require go1.7 for compilation #2154
...
* Update the travis tests to exclude go1.6
* Update the compile check to require go1.7+
* Update misc go1.6 workarounds marked in the source
2018-04-06 20:18:14 +01:00
Nick Craig-Wood
a5c3bcc9c7
fshttp: fix idle timeouts for HTTP connections #2057
...
Now we only nudge on the idle timeout after a successful Read or Write
which returns some bytes and no errors.
2018-02-16 10:35:41 +00:00
Nick Craig-Wood
11da2a6c9b
Break the fs package up into smaller parts.
...
The purpose of this is to make it easier to maintain and eventually to
allow the rclone backends to be re-used in other projects without
having to use the rclone configuration system.
The new code layout is documented in CONTRIBUTING.
2018-01-15 17:51:14 +00:00