Nick Craig-Wood
ff0b8e10af
s3: Support Alibaba Cloud (Aliyun) OSS
...
The existing s3 backend passed all integration tests with OSS provided
`force_path_style = false`.
This makes sure that is so and adds documentation and configuration
for OSS.
Thanks to @luolibin for their work on the OSS backend which we ended
up not needing.
Fixes #1641
Fixes #1237
2019-01-12 17:28:04 +00:00
Nick Craig-Wood
781142a73f
Add qip to contributors
2019-01-11 17:35:47 +00:00
Nick Craig-Wood
d7a1fd2a6b
Add Dario Guzik to contributors
2019-01-11 14:14:12 +00:00
Nick Craig-Wood
0ec6dd9f4b
Add nicolov to contributors
2019-01-09 19:29:26 +00:00
Fabian Möller
0458b961c5
sftp: add option to force the usage of an ssh-agent
...
Also adds the possibility to specify a specific key to request from the
ssh-agent.
2019-01-09 10:11:33 +01:00
Fabian Möller
c1998c4efe
sftp: add support for PEM encrypted private keys
2019-01-09 10:11:33 +01:00
Nick Craig-Wood
60e6af2605
Add andrea rota to contributors
2019-01-05 20:56:03 +00:00
andrea rota
9d16822c63
note on minimum version with support for b2 multi application keys
...
This trivial patch adds a note about the minimum version of rclone
needed in order to be able to use multiple application keys with the b2
backend.
As Debian stable (amongst other distros) is shipping an older version,
users running rclone < 1.43 and reading about this feature in the online
docs may struggle to realise why they are not able to sync to b2 when
configured to use an application key other than the master one.
For reference: https://github.com/ncw/rclone/issues/2513
2019-01-04 11:22:20 +00:00
Cnly
38a0946071
docs: update OneDrive limitations and versioning issue
2019-01-04 16:42:19 +08:00
Nick Craig-Wood
95e52e1ac3
cmd: improve error reporting for too many/few arguments - fixes #2860
...
Improve docs on the different kind of flag passing.
2018-12-29 17:40:21 +00:00
Nick Craig-Wood
6f30427357
yandex: note --timeout increase needed for large files
...
See: https://forum.rclone.org/t/rclone-stucks-at-the-end-of-a-big-file-upload/8102
2018-12-29 16:08:40 +00:00
Nick Craig-Wood
39eac7a765
Add Jay to contributors
2018-12-26 15:08:09 +00:00
Nick Craig-Wood
37e32d8c80
Add Arkadius Stefanski to contributors
2018-12-26 15:03:27 +00:00
Nick Craig-Wood
4128e696d6
Add François Leurent to contributors
...
New email for Animosity022
2018-12-26 15:00:16 +00:00
Animosity022
5babf2dc5c
Update drive.md
...
Fixed the Google Drive API documentation
2018-12-22 18:37:00 +00:00
Nick Craig-Wood
e7684b7ed5
Add William Cocker to contributors
2018-12-06 21:53:53 +00:00
William Cocker
dda23baf42
s3 : update doc for Glacier storage class
...
s3 : update doc for Glacier storage class : related to #923
2018-12-06 21:53:38 +00:00
Nick Craig-Wood
d3e8ae1820
Add Mark Otway to contributors
2018-12-06 15:13:03 +00:00
Nick Craig-Wood
91a9a959a2
Add Mathieu Carbou to contributors
2018-12-06 15:12:58 +00:00
Mark Otway
04eae51d11
Fix install for Synology
...
7z check doesn't work due to misplaced comma, so installation fails on Synology.
2018-12-06 15:12:21 +00:00
Nick Craig-Wood
35fba5bfdd
Add Garry McNulty to contributors
2018-12-02 20:52:04 +00:00
Garry McNulty
887834da91
b2: cleanup unfinished large files
...
The `cleanup` command will delete unfinished large file uploads that
were started more than a day ago (to avoid deleting uploads that are
potentially still in progress).
Fixes #2617
2018-12-02 20:51:13 +00:00
Nick Craig-Wood
107293c80e
copy,move: restore --no-traverse flag
...
The --no-traverse flag was not implemented when the new sync routines
(using the march package) was implemented.
This re-implements --no-traverse in march by trying to find a match
for each object with NewObject rather than from a directory listing.
2018-12-02 20:28:13 +00:00
Nick Craig-Wood
d99ffde7c0
s3: change --s3-upload-concurrency default to 4 to increase perfomance #2772
...
Increasing the --s3-upload-concurrency to 4 (from 2) gives an
additional 45% throughput at the cost of 10MB extra memory per transfer.
After testing the upload perfoc
2018-12-02 17:58:34 +00:00
Nick Craig-Wood
198c34ce21
s3: implement --s3-upload-cutoff for single part uploads below this - fixes #2772
...
Before this change rclone would use multipart uploads for any size of
file. However multipart uploads are less efficient for smaller files
and don't have MD5 checksums so it is advantageous to use single part
uploads if possible.
This implements single part uploads for all files smaller than the
upload_cutoff size. Streamed files must be uploaded as multipart
files though.
2018-12-02 17:58:34 +00:00
Nick Craig-Wood
d35bd15762
Version v1.45
2018-11-24 13:44:25 +00:00
Nick Craig-Wood
5fe3b0ad71
Add Stephen Harris to contributors
2018-11-24 10:57:37 +00:00
Stephen Harris
4c8c87a935
Update PROXY section of the FAQ
2018-11-23 20:14:36 +00:00
Sebastian Bünger
703b0535a4
yandex: update docs
2018-11-22 20:14:50 +00:00
Nick Craig-Wood
26e2f1a998
Add Alexander to contributors
2018-11-20 10:22:11 +00:00
Alexander
2682d5a9cf
- install with busybox if any
2018-11-20 10:22:00 +00:00
Nick Craig-Wood
2191592e80
Add Henry Ptasinski to contributors
2018-11-19 13:33:59 +00:00
Nick Craig-Wood
18f758294e
Add Peter Kaminski to contributors
2018-11-19 13:33:59 +00:00
Peter Kaminski
64fce8438b
docs: Fix a couple of minor typos in rclone_mount.md
...
* "transferring" instead of "transfering"
* "connection" instead of "connnection"
* "mount" instead of "mount mount"
2018-11-14 22:48:58 +00:00
Nick Craig-Wood
3975d82b3b
Add brused27 to contributors
2018-11-13 17:00:26 +00:00
Anagh Kumar Baranwal
1b78f4d1ea
Changed the docs scripts to use $HOME & $USER instead of specific values
...
Signed-off-by: Anagh Kumar Baranwal <anaghk.dos@gmail.com>
2018-11-13 11:00:34 +00:00
Nick Craig-Wood
16f797a7d7
filter: add --ignore-case flag - fixes #502
...
The --ignore-case flag causes the filtering of file names to be case
insensitive. The flag name comes from GNU tar.
2018-11-12 14:29:37 +00:00
Nick Craig-Wood
9b3c951ab7
Add Jake Coggiano to contributors
2018-11-12 11:34:28 +00:00
Nick Craig-Wood
84202c7471
onedrive: note 50,000 files is limit for one directory #2707
2018-11-11 15:22:19 +00:00
Nick Craig-Wood
c4b0a37b21
rc: improve docs on debugging
2018-11-10 10:18:13 +00:00
Nick Craig-Wood
9322f4baef
Add Erik Swanson to contributors
2018-11-08 12:58:41 +00:00
Nick Craig-Wood
c0f600764b
Add Scott Edlund to contributors
2018-11-07 14:27:06 +00:00
Nick Craig-Wood
2b1194c57e
rc: update docs with new methods
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
75a88de55c
rc/rcserver: with --rc-files if auth set, pass on to URL opened
...
If `--rc-user` or `--rc-pass` is set then the URL that is opened with
`--rc-files` will have the authorization in the URL in the
`http://user:pass@localhost/ ` style.
2018-11-05 15:44:40 +00:00
Nick Craig-Wood
fa0a9653d2
rc: methods marked as AuthRequired need auth unless --rc-no-auth
...
Methods which can read or mutate external storage will require
authorisation - enforce this. This can be overidden by `--rc-no-auth`.
2018-11-04 20:42:57 +00:00
Nick Craig-Wood
89550e7121
rcserver: serve directories as well as files
2018-11-04 15:11:51 +00:00
Nick Craig-Wood
0bfa9811f7
rc: factor server code into rcserver and implement serving objects
...
If a GET or HEAD request is receivied with a URL parameter of fs then
it will be served from that remote.
2018-11-03 11:32:00 +00:00
Nick Craig-Wood
2089405e1b
fs/rc: add more infrastructure to help writing rc functions
...
- Fs cache for rc commands
- Helper functions for parsing the input
- Reshape command for manipulating JSON blobs
- Background Job starting, control, query and expiry
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
45d5339fcb
cmd/rc: add --json flag for structured JSON input
2018-11-02 17:32:20 +00:00
Nick Craig-Wood
04c0564fe2
Add Ralf Hemberger to contributors
2018-11-02 09:53:23 +00:00
Nick Craig-Wood
f7c31cd210
Add Florian Gamboeck to contributors
2018-10-27 00:28:11 +01:00
Anagh Kumar Baranwal
e76cf1217f
Added docs to check for key generation on Mega
...
Signed-off-by: Anagh Kumar Baranwal <anaghk.dos@gmail.com>
2018-10-25 22:49:21 +01:00
Nick Craig-Wood
c5ac96e9e7
Make --files-from only read the objects specified and don't scan directories
...
Before this change using --files-from would scan all the directories
that the files could possibly be in causing rclone to do more work
that was necessary.
After this change, rclone constructs an in memory tree using the
--fast-list mechanism but from all of the files in the --files-from
list and without scanning any directories.
Any objects that are not found in the --files-from list are ignored
silently.
This mechanism is used for sync/copy/move (march) and all of the
listing commands ls/lsf/md5sum/etc (walk).
2018-10-20 18:13:31 +01:00
Nick Craig-Wood
f96ce5674b
Version v1.44
2018-10-15 11:03:08 +01:00
Nick Craig-Wood
83b1ae4833
Add buergi to contributors
2018-10-14 17:20:34 +01:00
Nick Craig-Wood
a3dc591b8e
Add teresy to contributors
2018-10-14 00:19:49 +01:00
Nick Craig-Wood
0f02c9540c
s3: make --s3-v2-auth flag
...
This is an alternative to setting the region to "other-v2-signature"
which is inconvenient for multi-region providers.
2018-10-14 00:10:29 +01:00
Nick Craig-Wood
014d58a757
Add David Haguenauer to contributors
2018-10-13 12:56:21 +01:00
David Haguenauer
1d16e16b30
docs: replace "Github" with "GitHub"
...
This the way GitHub refer to themselves.
2018-10-13 12:55:45 +01:00
Nick Craig-Wood
8d72ef8d1e
cmd: Don't print non-ASCII characters with --progress on windows - fixes #2501
...
This bug causes lots of strange behaviour with non-ASCII characters and --progress
https://github.com/Azure/go-ansiterm/issues/26
2018-10-11 21:25:04 +01:00
Nick Craig-Wood
ee25b6106a
Add jackyzy823 to contributors
2018-10-11 14:50:33 +01:00
Nick Craig-Wood
5c1b135304
Add dcpu to contributors
2018-10-11 14:50:33 +01:00
jackyzy823
411a6cc472
onedrive: add link sharing support #2178
2018-10-09 20:11:48 +08:00
Nick Craig-Wood
78b9bd77f5
docs: auto generate backend options documentation
...
This inserts the output of "rclone help backend xxx" into the help
pages for each backend.
2018-10-06 11:47:46 +01:00
Nick Craig-Wood
a9273c5da5
docs: move documentation for options from docs/content into backends
...
In the following commit, the documentation will be autogenerated.
2018-10-06 11:47:46 +01:00
Nick Craig-Wood
ddbd4fd881
Add Paul Kohout to contributors
2018-10-04 08:25:39 +01:00
Alex Chen
d9037fe2be
onedrive: ignore OneNote files by default - fixes #211
2018-10-03 12:46:25 +08:00
Nick Craig-Wood
fc640d3a09
Add Frantisek Fuka to contributors
2018-09-29 14:55:11 +01:00
Frantisek Fuka
e1f67295b4
b2: add note about cleanup in docs
...
Added: "Note that `cleanup` does not remove partially uploaded filesfrom the bucket."
2018-09-29 14:47:31 +01:00
Nick Craig-Wood
c7aa6b587b
Add xnaas to contributors
2018-09-26 10:07:13 +01:00
xnaas
8d1848bebe
docs: note --track-renames doesn't work with crypt
2018-09-26 10:06:19 +01:00
Fabian Möller
15b1a1f909
drive: add support for apps-script to json export
2018-09-25 15:20:23 +01:00
Fabian Möller
70b30d5ca4
drive: add document links
2018-09-25 15:20:23 +01:00
Fabian Möller
171e39b230
drive: add --drive-import-formats
...
Add a new flag to the drive backend to allow document conversions oni upload.
The existing --drive-formats flag has been renamed to --drive-export-formats.
The old flag is still working to be backward compatible.
2018-09-25 15:20:23 +01:00
Nick Craig-Wood
96ce49ec4e
Add ssaqua to contributors
2018-09-24 17:08:47 +01:00
Nick Craig-Wood
e2fb588eb9
Add frenos to contributors
2018-09-24 17:05:03 +01:00
frenos
382a6863b5
rc: add support for OPTIONS and basic CORS - #2575
2018-09-24 17:04:47 +01:00
Nick Craig-Wood
b22ecbe174
Add Joanna Marek to contributors
2018-09-18 10:27:33 +01:00
Nick Craig-Wood
c41be436c6
Add Antoine GIRARD to contributors
2018-09-18 10:27:33 +01:00
albertony
cfe65f1e72
jottacloud: minor update in docs
2018-09-18 10:25:30 +01:00
Nick Craig-Wood
b2a6a97443
Add Craig Miskell to contributors
2018-09-11 07:57:16 +01:00
Jon Craton
19cf3bb9e7
Fixed typo (duplicate word) ( #2563 )
2018-09-10 19:09:48 -07:00
Fabian Möller
e5663de09e
docs: add section for .plex.direct urls to cache
2018-09-10 21:15:18 +01:00
Nick Craig-Wood
7cfd4e56f8
Add Santiago Rodríguez to contributors
...
Another email address for Sandeep.
2018-09-10 20:49:55 +01:00
Santiago Rodríguez
282540c2d4
azureblob: add --azureblob-list-chunk parameter - Fixes #2390
...
This parameter can be used to adjust the size of the listing chunks
which can be used to workaround problems listing large buckets.
2018-09-10 20:45:06 +01:00
Fabian Möller
f6ee0795ac
cache: preserve leading / in wrapped remote path
...
When combining the remote value and the root path, preserve the absence
or presence of the / at the beginning of the wrapped remote path.
e.g. a remote "cloud:" and root path "dir" becomes "cloud:dir" instead
of "cloud:/dir".
Fixes #2553
2018-09-10 20:35:50 +01:00
albertony
d51501938a
jottacloud: add link sharing support
2018-09-08 09:38:57 +01:00
Nick Craig-Wood
a823d518ac
docs: changelog from v1.43.1 branch
2018-09-07 17:16:11 +01:00
Nick Craig-Wood
820d2a7149
Add Felix Brucker to contributors
2018-09-07 15:14:28 +01:00
Nick Craig-Wood
9fe39f25e1
union: add missing docs
2018-09-07 15:14:08 +01:00
Felix Brucker
9e3ea3c6ac
union: Implement union backend which reads from multiple backends
2018-09-07 15:14:08 +01:00
Anagh Kumar Baranwal
0fb12112f5
docs: display changes
...
- Reduced size of the social menu and increased the size of the content
- Added scrollable property to the index menus
- Fixed code wrapping issue
Fixes #2103
Signed-off-by: Anagh Kumar Baranwal <anaghk.dos@gmail.com>
2018-09-07 14:54:22 +01:00
albertony
e07a850be3
jottacloud: add permanent delete support: --jottacloud-hard-delete
2018-09-07 12:58:18 +01:00
albertony
3fccce625c
jottacloud: add --fast-list support - fixes #2532
2018-09-07 12:49:39 +01:00
albertony
a1f935e815
jottacloud: minor improvement in quota info (omit if unlimited)
2018-09-07 12:49:39 +01:00
Sebastian Bünger
c6f1c3c7f6
box: Implement link sharing. #2178
2018-09-04 22:01:22 +01:00
Nick Craig-Wood
3d2117887d
Add Anagh Kumar Baranwal to contributors
2018-09-04 16:16:46 +01:00
Anagh Kumar Baranwal
5a6750e1cd
cache: documentation fix for cache-chunk-total-size - Fixes #2519
...
Signed-off-by: Anagh Kumar Baranwal <anaghk.dos@gmail.com>
2018-09-04 16:16:35 +01:00
Nick Craig-Wood
172beb2ae3
Add cron410 to contributors
2018-09-03 20:28:15 +01:00
cron410
5eba392a04
cache: clarify docs
2018-09-03 20:28:15 +01:00
Nick Craig-Wood
2e37942592
Add albertony to contributors
2018-09-03 15:31:25 +01:00
Nick Craig-Wood
ff0efb1501
Add Sheldon Rupp to contributors
2018-09-03 15:04:37 +01:00
Sheldon Rupp
0f1d4a7ca8
docs: fix typo
2018-09-03 15:03:49 +01:00
Nick Craig-Wood
d3afef3e1b
Add dcpu to contributors
2018-09-02 18:11:42 +01:00
dcpu
f4aaec9ce5
log: Add --log-format flag - fixes #2424
2018-09-02 18:11:09 +01:00
Cnly
571c8754de
onedrive: graph: update docs
2018-09-02 16:06:25 +01:00
Nick Craig-Wood
05a615ef22
Add Dr. Tobias Quathamer to contributors
2018-09-02 15:51:47 +01:00
Nick Craig-Wood
86e64c626c
Add Cédric Connes to contributors
2018-09-02 15:08:38 +01:00
Nick Craig-Wood
7e5c6725c1
docs: Fix version in changelog
2018-09-01 18:40:34 +01:00
Nick Craig-Wood
20c55a6829
Version v1.43
2018-09-01 12:58:00 +01:00
Nick Craig-Wood
f243d2a309
Add bsteiss to contributors
2018-08-30 17:08:40 +01:00
Nick Craig-Wood
5afaa48d06
Add Denis to contributors
2018-08-30 16:47:32 +01:00
Nick Craig-Wood
5e75a9ef5c
build: switch to using go1.11 modules for managing dependencies
2018-08-28 17:08:22 +01:00
Nick Craig-Wood
84ef6b2ae6
Add Alex Chen to contributors
2018-08-27 08:34:57 +01:00
Nick Craig-Wood
8656bd2bb0
fs: Allow on the fly remotes with :backend: syntax - fixes #2449
...
This change allows remotes to be created on the fly without a config
file by using the remote type prefixed with a : as the remote name, Eg
:s3: to make an s3 remote.
This assumes the user is supplying the backend config via command line
flags or environment variables.
2018-08-26 17:59:31 +01:00
Nick Craig-Wood
b6db90cc32
cmd: add --progress/-P flag to show progress
...
Fixes #2347
Fixes #1210
2018-08-26 17:20:38 +01:00
sandeepkru
3751ceebdd
azureblob: Added blob tier feature, a new configuration of azureblob-access-tier
...
is added to tier blobs between Hot, Cool and Archive. Addresses #2901
2018-08-21 21:52:45 +01:00
Nick Craig-Wood
f9cf70e3aa
jottacloud: docs, fixes and tests for MD5 calculation
...
* Add docs for --jottacloud-md5-memory-limit
* Factor out readMD5 function and add tests
* Fix accounting
* Make sure temp file is deleted at the start (not Windows)
2018-08-21 08:57:53 +01:00
Fabian Möller
6dc5aa7454
docs: clearify buffer-size is per transfer/filehandle
2018-08-17 18:11:40 +01:00
Nick Craig-Wood
7d35b14138
Add Martin Polden to contributors
2018-08-17 18:08:48 +01:00
Nick Craig-Wood
6390dec7db
fs/accounting: add --stats-one-line flag for single line stats
2018-08-17 17:58:00 +01:00
Nick Craig-Wood
cb7a461287
sync: add a buffer for checks, uploads and renames #379
...
--max-backlog controls the queue length.
Add statistics for the check/upload/rename queues.
This means that checking can complete before the uploads which will
give rclone the ability to show exactly what is outstanding.
2018-08-17 17:58:00 +01:00
Nick Craig-Wood
751bfd456f
box: make --box-commit-retries flag defaulting to 100 - Fixes #2054
...
Sometimes it takes many more commit retries than expected to commit a
multipart file, so split this number into its own config variable and
default it to 100 which should always be enough.
2018-08-11 16:33:55 +01:00
Nick Craig-Wood
6301e15b79
Add Sebastian Bünger to contributors
2018-08-10 11:15:04 +01:00
Sebastian Bünger
007c7757d4
Add docs for Jottacloud
2018-08-10 11:14:34 +01:00
Nick Craig-Wood
05bec70c3e
Add Matt Tucker to contributors
2018-08-10 10:28:41 +01:00
Matt Tucker
c54f5a781e
Fix typo in Box documentation
2018-08-10 10:28:16 +01:00
Nick Craig-Wood
e979cd62c1
rc: fix formatting in docs
2018-08-07 21:05:21 +01:00
Nick Craig-Wood
687477b34d
rc: add core/stats and vfs/refresh to the docs
2018-08-07 20:58:00 +01:00
Nick Craig-Wood
40d383e223
Add reddi1 to contributors
2018-08-07 20:56:55 +01:00
Nick Craig-Wood
f7c1c61dda
Add Andres Alvarez to contributors
2018-08-07 20:52:04 +01:00
Nick Craig-Wood
d95667b06d
Add Cnly to contributors
2018-08-07 09:33:25 +01:00
Cnly
0f845e3a59
onedrive: implement DirMove - fixes #197
2018-08-07 09:33:19 +01:00
Nick Craig-Wood
7f3d5c31d9
Add Ruben Vandamme to contributors
2018-08-06 22:07:40 +01:00
Ruben Vandamme
578f56bba7
Swift: Add storage_policy
2018-08-06 22:07:25 +01:00
Nick Craig-Wood
f7c0b2407d
drive: add docs for --fast-list and add to integration tests
2018-08-06 21:38:50 +01:00
Nick Craig-Wood
3c2ffa7f57
Add Oleg Kovalov to contributors
2018-08-06 21:14:14 +01:00
Nick Craig-Wood
44abf6473e
Add dan smith to contributors
2018-08-06 21:08:37 +01:00
dan smith
b99595b7ce
docs: remove references to copy and move for --track-renames
...
this change was omitted in the fix for #2008
2018-08-06 21:08:19 +01:00
Nick Craig-Wood
a119ca9f10
b2: Support Application Keys - fixes #2428
...
This supports B2 application keys limited to a bucket by making sure
we only list the buckets of the bucket ID that the key is limited to.
2018-08-06 14:32:53 +01:00
Nick Craig-Wood
f9eb9c894d
mega: add --mega-hard-delete flag - fixes #2409
2018-08-03 15:07:51 +01:00
Nick Craig-Wood
f7a92f2c15
Add Andrew to contributors
2018-08-03 13:00:25 +01:00
Andrew
42959fe9c3
Swap cache-db-path and cache-chunk-path
...
Have the db path option come first in doc, as the chunk path references db and isn't needed if the preceding (db path) command is used.
2018-08-03 13:00:13 +01:00
Nick Craig-Wood
bbda4ab1f1
Add HerrH to contributors
2018-07-30 23:14:33 +01:00
HerrH
916b6e3a40
b2: Use create instead of make in the docs
2018-07-30 23:14:03 +01:00
Nick Craig-Wood
01af8e2905
s3: docs for how to configure Aliyun OSS / Netease NOS - thanks @xiaolei0125
2018-07-20 15:49:07 +01:00
Nick Craig-Wood
f06ba393b8
s3: Add --s3-force-path-style - fixes #2401
2018-07-20 15:41:40 +01:00
Nick Craig-Wood
028f8a69d3
acd: Make very clear in the docs that rclone has no ACD keys #2385
2018-07-15 14:21:19 +01:00
Nick Craig-Wood
99201f8ba4
Add sandeepkru to contributors
2018-07-14 10:50:58 +01:00
sandeepkru
5ad8bcb43a
backend/azureblob: Port new Azure Blob Storage SDK #2362
...
This change includes removing older azureblob storage SDK, and getting
parity to existing code with latest blob storage SDK.
This change is also pre-req for addressing #2091
2018-07-14 10:49:58 +01:00